-- Logs begin at Fri 2022-06-03 12:15:22 UTC, end at Fri 2022-06-03 13:35:45 UTC. -- Jun 03 12:47:28.749026 dv-cinder-779540-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 03 12:47:28.757811 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 12:47:28 2022] *** Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: nodename: dv-cinder-779540-3-iscsi Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: machine: x86_64 Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: clock source: unix Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: pcre jit disabled Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: detected number of CPU cores: 4 Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: current working directory: / Jun 03 12:47:28.759864 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: detected binary path: /usr/bin/uwsgi-core Jun 03 12:47:28.760501 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: your processes number limit is 47680 Jun 03 12:47:28.760501 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: your memory page size is 4096 bytes Jun 03 12:47:28.760501 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: detected max file descriptor number: 2048 Jun 03 12:47:28.760501 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: lock engine: pthread robust mutexes Jun 03 12:47:28.760501 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: thunder lock: enabled Jun 03 12:47:28.760501 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 03 12:47:28.760501 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 12:47:28.804152 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: Python main interpreter initialized at 0x55d92a4ef9c0 Jun 03 12:47:28.804152 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: python threads support enabled Jun 03 12:47:28.804152 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: your server socket listen backlog is limited to 100 connections Jun 03 12:47:28.804152 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: your mercy for graceful operations on workers is 90 seconds Jun 03 12:47:28.804456 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 12:47:28.804530 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: *** Operational MODE: preforking *** Jun 03 12:47:28.804777 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: *** uWSGI is running in multiple interpreter mode *** Jun 03 12:47:28.804777 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: spawned uWSGI master process (pid: 80225) Jun 03 12:47:28.804993 dv-cinder-779540-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 03 12:47:28.805668 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: spawned uWSGI worker 1 (pid: 80234, cores: 1) Jun 03 12:47:28.806963 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: spawned uWSGI worker 2 (pid: 80235, cores: 1) Jun 03 12:47:28.806963 dv-cinder-779540-3-iscsi devstack@keystone.service[80225]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 12:47:34.450408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:47:34.450408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jun 03 12:47:34.451247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:47:34.451247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: from cryptography.utils import int_from_bytes Jun 03 12:47:34.451656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:47:34.451656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jun 03 12:47:34.451763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:47:34.451763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: from cryptography.utils import int_from_bytes Jun 03 12:47:34.500400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 12:47:34.500598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 12:47:34.500680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 12:47:34.500761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] command line args: [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 12:47:34.500828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 12:47:34.500985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] command line args: [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 12:47:34.501071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 12:47:34.501206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ================================================================================ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 12:47:34.501338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 12:47:34.501419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.501507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ================================================================================ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 12:47:34.501681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] config_dir = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.501816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] admin_token = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.501892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.501963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] config_dir = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] config_source = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] debug = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] config_source = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] debug = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.502959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.503084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.503169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.503300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.503384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.503744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.503868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.503868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] log_config_append = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] log_config_append = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] log_dir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] log_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] log_dir = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] log_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.504986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.505897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.506969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.507076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.507215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.507298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.507412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.507586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.507721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.507884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] publish_errors = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] publish_errors = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.508994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] standard_threads = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.509933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] standard_threads = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510301 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] use_journal = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] use_json = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] use_journal = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] use_stderr = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] use_json = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.510951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] use_syslog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.511030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] use_stderr = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.511102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.511178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] use_syslog = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.511328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.511463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:47:34.511554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.511630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.511801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.511926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.512843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.513863 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.514857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.515981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.516964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.517971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.518877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.519994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.520912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.521891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.522995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523235 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.523919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.524929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.525858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.526964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.527942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.528958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.529979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.530845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531832 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.531959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.532984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.533975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.534933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.external = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.535931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.external = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.password = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.token = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.536899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.password = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.token = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.537865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.538990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.539912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.540883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.541225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.541355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.541471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.541471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.541692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.541817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.541933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.542897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.543016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.543610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.543736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.543814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.543876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.543947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.544792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545749 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.545965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.546931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.547939 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.548933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.549925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.550982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.551818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552782 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.552948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.553940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.554915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.555989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.556957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.557908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.558049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.558194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.558310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.558559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.558641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.558800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.558880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.559981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.560922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.561967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.562928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.563873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.564977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.565995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.566970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.567913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] role.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.568859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] role.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] role.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] role.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.569966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.570997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.571952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.572032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.572194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.572328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.572486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.572566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.572774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.572894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.573980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.574097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.574267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.574360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.574520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.574599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.574774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.574852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.575985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576514 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.576976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.577910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.578885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.579991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.580929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.581990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.582983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.583934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.584878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.585940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.586032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.586170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 12:47:34.586249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.586450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.586689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:47:34.586863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 12:47:34.615570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.615799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.616011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.616156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.616581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.616804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.625100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.625503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.653314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.653503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.653945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.654184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.707263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.707422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.756759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.756977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.757074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.757308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.823333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.823518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.823590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.823678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.823757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.823821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.823965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.824099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.824185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.824267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.824415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.824541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.847484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.847733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.847833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.847904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.848939 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.849162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.860046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.860503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.873217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.873419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.873503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.873704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.873829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.873899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.873976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.874056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.874165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.874289 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.874418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.874491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.874589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.874821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 12:47:34.891746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.891964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 12:47:34.892116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.892222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 12:47:34.892291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.892463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 12:47:34.892588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.892702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 12:47:34.892794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.892978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.893102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.893204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.893295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.893466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.893573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.893744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.904605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.904886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.905013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.905119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.905272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.905438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.905566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.905831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.913494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.913979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.917058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.917336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.917463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.917619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.917766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.917875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.917969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.918214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.918341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.918494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.918642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.918841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.918967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.919107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.919232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.919399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.919526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.919676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.919801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.919909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.920015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.920183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.946577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.946722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.948409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.948685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.948838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.949088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.953935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.954248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.954374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.954474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.954639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.954949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.961786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.962077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.962242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.962509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.966676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.967071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.967195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.967351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.967497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.967609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.967702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.967920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.968053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.968172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.968264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.968472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.968599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.968747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.968888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.969059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.987103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.987378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.987997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.988275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.992327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.993296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:34.996172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.996461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.997109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:34.997415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.001387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.002431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.004949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.006020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.010149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.010540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.010822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.011104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.011266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.011451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.011569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.011711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.011832 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.012153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.012434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.012713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.031703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.031952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.032090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.032191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.032259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.032493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.032623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.032748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.040433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.040714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.042297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.042522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.042650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.042844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.045549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.045827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.045952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.046094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.046206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.046399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.046545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.046686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.046769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.046966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.060321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.060449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.060612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.060698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.060860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.061940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.062023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.079933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.080080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.083171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.083300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.086448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.086576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.088063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.088191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.089776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.089902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.090042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.090148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.090356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.090483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.097722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.097849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.099351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.099499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.102534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.102663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.102817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.102899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.103080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.103226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.103367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.103450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.112367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.112497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.112657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.112781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.113017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.113143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.121286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.121537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.121636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 12:47:35.121834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.121961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.122101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.122214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.122356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.122559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.122684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.122820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.122901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.123084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.123212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.123352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.123449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.123631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.123718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.123889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.124950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.125225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 12:47:35.162447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d92a4ef9c0 pid: 80234 (default app) Jun 03 12:47:35.163257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d92a4ef9c0 pid: 80235 (default app) Jun 03 12:47:35.165793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab317c3-d494-407c-bae4-697e27897510 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:35.166224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab317c3-d494-407c-bae4-697e27897510 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:35.166390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab317c3-d494-407c-bae4-697e27897510 None None] PATH_INFO: `/v3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:35.170777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Fri Jun 3 12:47:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:43.270577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5196a9-7306-4684-bd68-923e493c9017 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:43.271447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5196a9-7306-4684-bd68-923e493c9017 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:43.271447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5196a9-7306-4684-bd68-923e493c9017 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:43.277703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:47:43.283486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:43.283886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:43.284072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:43.352249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: INFO dbcounter [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] Registered counter for database keystone Jun 03 12:47:43.377892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG oslo_db.sqlalchemy.engines [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:47:43.384780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writer thread running {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:47:43.688351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80234) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 12:47:43.688790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80234) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 12:47:43.745432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:43.747075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:43.888695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 606 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 12:47:44.078209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5196a9-7306-4684-bd68-923e493c9017 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:44.157262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: INFO dbcounter [None req-6e5196a9-7306-4684-bd68-923e493c9017 None None] Registered counter for database keystone Jun 03 12:47:44.179123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG oslo_db.sqlalchemy.engines [None req-6e5196a9-7306-4684-bd68-923e493c9017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:47:44.191626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writer thread running {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:47:44.424393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5196a9-7306-4684-bd68-923e493c9017 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:44.433960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288dc3-c5c1-4595-9b26-178cba39b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:44.435095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288dc3-c5c1-4595-9b26-178cba39b2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:44.435577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288dc3-c5c1-4595-9b26-178cba39b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:44.436042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288dc3-c5c1-4595-9b26-178cba39b2ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:44.450366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288dc3-c5c1-4595-9b26-178cba39b2ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:44.503438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ae288dc3-c5c1-4595-9b26-178cba39b2ca admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 12:47:44.503784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288dc3-c5c1-4595-9b26-178cba39b2ca admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:44.514439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Fri Jun 3 12:47:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:47:44.524230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:44.540009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709438f-2944-49bc-9ee6-abebb897a221 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:44.546306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7ea59-d60c-42da-947c-13a695e9dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:44.547462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ea59-d60c-42da-947c-13a695e9dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:44.547751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ea59-d60c-42da-947c-13a695e9dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:44.548035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ea59-d60c-42da-947c-13a695e9dbb9 admin admin] PATH_INFO: `/v3/projects/8cee784ec8864757a1c8441df24c7f48` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:44.549647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ea59-d60c-42da-947c-13a695e9dbb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=8cee784ec8864757a1c8441df24c7f48)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:44.600817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING keystone.common.rbac_enforcer.enforcer [None req-93f7ea59-d60c-42da-947c-13a695e9dbb9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 12:47:44.601154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ea59-d60c-42da-947c-13a695e9dbb9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:44.606246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Fri Jun 3 12:47:44 2022] GET /identity/v3/projects/8cee784ec8864757a1c8441df24c7f48 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:46.838887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1b565-f453-4e09-af40-b0a64bfb0000 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:46.839402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1b565-f453-4e09-af40-b0a64bfb0000 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:46.839402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1b565-f453-4e09-af40-b0a64bfb0000 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:46.843499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:46.850824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36581-e54f-4dbb-ae98-a2fe2890c197 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:46.851534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36581-e54f-4dbb-ae98-a2fe2890c197 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:46.851670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36581-e54f-4dbb-ae98-a2fe2890c197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:46.877968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dba36581-e54f-4dbb-ae98-a2fe2890c197 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:46.879523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dba36581-e54f-4dbb-ae98-a2fe2890c197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:46.888246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 12:47:46.915142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1b565-f453-4e09-af40-b0a64bfb0000 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:46.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1b565-f453-4e09-af40-b0a64bfb0000 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:46.936082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508a018-ad48-447f-9c6f-2aadaa2eda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:46.936724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a018-ad48-447f-9c6f-2aadaa2eda3d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:46.937005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a018-ad48-447f-9c6f-2aadaa2eda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:46.937278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a018-ad48-447f-9c6f-2aadaa2eda3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:46.945661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508a018-ad48-447f-9c6f-2aadaa2eda3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:46.947489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508a018-ad48-447f-9c6f-2aadaa2eda3d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:46.957066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Fri Jun 3 12:47:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:47:46.963532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36581-e54f-4dbb-ae98-a2fe2890c197 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:46.973577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36581-e54f-4dbb-ae98-a2fe2890c197 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:46.979949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c21d1b-a29e-424e-a0b1-25270959bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:46.980822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21d1b-a29e-424e-a0b1-25270959bea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:46.981106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21d1b-a29e-424e-a0b1-25270959bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:46.981379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21d1b-a29e-424e-a0b1-25270959bea1 admin admin] PATH_INFO: `/v3/users/0996f80baf904a69852b0b6c8fb6bc6f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:46.983030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c21d1b-a29e-424e-a0b1-25270959bea1 admin admin] RBAC: Authorizing `identity:get_user(user_id=0996f80baf904a69852b0b6c8fb6bc6f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:46.984884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c21d1b-a29e-424e-a0b1-25270959bea1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:46.986498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Fri Jun 3 12:47:46 2022] GET /identity/v3/users/0996f80baf904a69852b0b6c8fb6bc6f => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:49.329974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844d0d-7e52-41bb-a4b1-04c304f9f061 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.330544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844d0d-7e52-41bb-a4b1-04c304f9f061 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.330642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844d0d-7e52-41bb-a4b1-04c304f9f061 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.332450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:49.333355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f61cb-8b69-4e8d-99dd-f2df7d4a39e7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.333762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f61cb-8b69-4e8d-99dd-f2df7d4a39e7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.333941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f61cb-8b69-4e8d-99dd-f2df7d4a39e7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.336219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:49.339843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.340134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.340413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.341850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cec0-5f1a-4cf0-a602-20046c910d4d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.342141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cec0-5f1a-4cf0-a602-20046c910d4d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.342455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cec0-5f1a-4cf0-a602-20046c910d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.359258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a4a8cec0-5f1a-4cf0-a602-20046c910d4d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:49.360451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a4a8cec0-5f1a-4cf0-a602-20046c910d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:49.382616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG passlib.handlers.bcrypt [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80235) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 12:47:49.383044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG passlib.handlers.bcrypt [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80235) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 12:47:49.430422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:49.432011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:49.445939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 7/12] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:47:49.468704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8cec0-5f1a-4cf0-a602-20046c910d4d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:49.494801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:49.536009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 6/13] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:47:49.559831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:49.579176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8cec0-5f1a-4cf0-a602-20046c910d4d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:49.614329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:49.614916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.615196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.615470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.665468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e191fb-b507-40c7-bde4-3586a39893c3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:49.668392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:49.682237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:49.683736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:49.703678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:49.704744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.705041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.705322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.708429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:49.717819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:47:49.729147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:47:49.730081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:47:49.731086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:47:49.736241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:49.788113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 8/15] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:47:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:47:49.794206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:49.838025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178380e-53a6-40e1-bd6f-4f08c7b68f0f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:49.874529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:49.875135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.875414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.875691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.876450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:47:49.876761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:49.878269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:49.890606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 8/16] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:49.890742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662d34c-b5ac-42f3-9f69-ef5bac86f8c4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:49.895891 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:49.914367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:49.924638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:49.926536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:49.927381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:49.927670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:49.927972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:49.938459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:49.939957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:47:49.960823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:47:49.961694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:47:49.962546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:47:49.962546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:47:49.962546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:47:49.962546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:47:49.962546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:47:49.968270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:49.999599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15938661-4261-437f-a0a5-8a4309310587 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:50.033666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:50.034596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:50.034883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:50.035162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] PATH_INFO: `/v3/users/0996f80baf904a69852b0b6c8fb6bc6f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:50.036739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] RBAC: Authorizing `identity:get_user(user_id=0996f80baf904a69852b0b6c8fb6bc6f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:50.038248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:50.039942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:47:49 2022] GET /identity/v3/users/0996f80baf904a69852b0b6c8fb6bc6f => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:50.045616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:50.070421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583f800-4799-4bfd-82f0-919f8512e22d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:50.104490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:50.105148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:50.105429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:50.105698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:50.106451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:47:50.106759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:50.108148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:50.125930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:50.140849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:50.148534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c4603-45c8-4733-ba6b-81712885ce46 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:50.186658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af7099-84c5-43b6-948d-a3f50300d9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:50.187483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7099-84c5-43b6-948d-a3f50300d9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:50.187764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7099-84c5-43b6-948d-a3f50300d9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:50.188035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7099-84c5-43b6-948d-a3f50300d9c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:50.189327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af7099-84c5-43b6-948d-a3f50300d9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:50.190893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af7099-84c5-43b6-948d-a3f50300d9c7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:50.192616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 10/20] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:47:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:47:50.198877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:50.237119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:50.310950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236e3eb-52d4-422b-a785-69829fdc9007 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:50.346841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8794f-ff50-4386-8c5c-2da49bcbb68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:50.347514 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8794f-ff50-4386-8c5c-2da49bcbb68f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:50.347800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8794f-ff50-4386-8c5c-2da49bcbb68f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:50.348078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8794f-ff50-4386-8c5c-2da49bcbb68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:50.349177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8794f-ff50-4386-8c5c-2da49bcbb68f None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.domain.id=default, user.id=0996f80baf904a69852b0b6c8fb6bc6f) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:47:50.349287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8794f-ff50-4386-8c5c-2da49bcbb68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:50.350732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8794f-ff50-4386-8c5c-2da49bcbb68f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:50.360071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 11/21] 10.222.0.58 () {56 vars in 1322 bytes} [Fri Jun 3 12:47:50 2022] GET /identity/v3/role_assignments?user.id=0996f80baf904a69852b0b6c8fb6bc6f&scope.domain.id=default&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:52.952853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e561eb-e94a-427f-b7ba-e157171f460d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:52.953877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e561eb-e94a-427f-b7ba-e157171f460d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:52.954402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e561eb-e94a-427f-b7ba-e157171f460d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:52.955973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 11/22] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:52.961487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb54d4-2be3-4df5-8fcf-690381614235 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:52.962339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb54d4-2be3-4df5-8fcf-690381614235 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:52.962815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb54d4-2be3-4df5-8fcf-690381614235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:52.986250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a3cb54d4-2be3-4df5-8fcf-690381614235 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:52.987811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a3cb54d4-2be3-4df5-8fcf-690381614235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:53.056210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342940-8f8c-43c5-b3cf-064b6e6ea41f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.056886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342940-8f8c-43c5-b3cf-064b6e6ea41f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.057579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342940-8f8c-43c5-b3cf-064b6e6ea41f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.059897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 12/23] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:47:53.071787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75b83-10a8-4d45-96d3-b40fe9c719c5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.072400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75b83-10a8-4d45-96d3-b40fe9c719c5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.072956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75b83-10a8-4d45-96d3-b40fe9c719c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.100742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 12/24] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:47:53.102019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-70a75b83-10a8-4d45-96d3-b40fe9c719c5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:53.107568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-70a75b83-10a8-4d45-96d3-b40fe9c719c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:53.135614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb54d4-2be3-4df5-8fcf-690381614235 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:53.198500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:53.229976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 13/25] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:47:53.238131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488fb4-7a94-4ccf-b98e-724cfdfefb5e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.238657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488fb4-7a94-4ccf-b98e-724cfdfefb5e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.239097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488fb4-7a94-4ccf-b98e-724cfdfefb5e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.240568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 14/26] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:53.251198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab10c99-57c6-4b98-9d3b-03d6e505aa85 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.251758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab10c99-57c6-4b98-9d3b-03d6e505aa85 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.252207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab10c99-57c6-4b98-9d3b-03d6e505aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.259488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb54d4-2be3-4df5-8fcf-690381614235 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:53.282296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5ab10c99-57c6-4b98-9d3b-03d6e505aa85 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:53.283798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5ab10c99-57c6-4b98-9d3b-03d6e505aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:53.334849 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:53.335775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.336130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.336485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.353032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 15/27] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 03 12:47:53.358256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab10c99-57c6-4b98-9d3b-03d6e505aa85 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:53.359433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:47:53.376642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:47:53.377546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:47:53.378580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 13/28] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:47:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:47:53.383805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:53.402299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:53.495884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab10c99-57c6-4b98-9d3b-03d6e505aa85 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:53.545521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87885876-4567-499a-b324-a4aee09c49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:53.546421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87885876-4567-499a-b324-a4aee09c49ff None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.547077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87885876-4567-499a-b324-a4aee09c49ff None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.548335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87885876-4567-499a-b324-a4aee09c49ff None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.550149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87885876-4567-499a-b324-a4aee09c49ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:53.552669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87885876-4567-499a-b324-a4aee09c49ff None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:53.618036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:53.645336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b527b-fe41-4292-b7c1-b391910825ae None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:53.681362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:53.682479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.683118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.683542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.684441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:47:53.684948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:53.686593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:53.699665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 14/29] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:47:53.700783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:53.714952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 16/30] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 3 12:47:53 2022] POST /identity/v3/roles => generated 225 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:47:53.716756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9bdb-ac97-4f45-ab78-4a47cdee6398 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.717195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9bdb-ac97-4f45-ab78-4a47cdee6398 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.717618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9bdb-ac97-4f45-ab78-4a47cdee6398 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.719140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 17/31] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:53.720047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9bdb-ac97-4f45-ab78-4a47cdee6398 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:53.877261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:53.905909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c535e-6630-4b6b-ac64-dabe09fd21cf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:53.922656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9bdb-ac97-4f45-ab78-4a47cdee6398 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:53.977352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:53.978676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.979167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.979591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.980504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:53.982398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:53.991882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ca5b1-5a0d-402f-87bb-05e58a35c0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:53.993771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ca5b1-5a0d-402f-87bb-05e58a35c0db None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:53.994238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ca5b1-5a0d-402f-87bb-05e58a35c0db None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:53.994745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ca5b1-5a0d-402f-87bb-05e58a35c0db None admin] PATH_INFO: `/v3/users/0996f80baf904a69852b0b6c8fb6bc6f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:53.997149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ca5b1-5a0d-402f-87bb-05e58a35c0db None admin] RBAC: Authorizing `identity:get_user(user_id=0996f80baf904a69852b0b6c8fb6bc6f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:53.999020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ca5b1-5a0d-402f-87bb-05e58a35c0db None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:54.000948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 18/32] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:47:53 2022] GET /identity/v3/users/0996f80baf904a69852b0b6c8fb6bc6f => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:54.002506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea97b36-bd4f-4c71-bbd5-69cb02ae2228 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.002971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea97b36-bd4f-4c71-bbd5-69cb02ae2228 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.003409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea97b36-bd4f-4c71-bbd5-69cb02ae2228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.030085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7ea97b36-bd4f-4c71-bbd5-69cb02ae2228 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:54.031844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7ea97b36-bd4f-4c71-bbd5-69cb02ae2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:54.107508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 19/33] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:47:54.108151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea97b36-bd4f-4c71-bbd5-69cb02ae2228 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.137077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 15/34] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 3 12:47:53 2022] POST /identity/v3/roles => generated 219 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:47:54.141892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.174575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:54.268733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:54.308394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea97b36-bd4f-4c71-bbd5-69cb02ae2228 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:54.338330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c758c4b-9485-4508-8443-e36048e18f04 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:54.348090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d1b6a-c2dd-4def-94e7-ab0e6a4d0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:54.349086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d1b6a-c2dd-4def-94e7-ab0e6a4d0d02 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.349376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d1b6a-c2dd-4def-94e7-ab0e6a4d0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.349709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d1b6a-c2dd-4def-94e7-ab0e6a4d0d02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.351119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d1b6a-c2dd-4def-94e7-ab0e6a4d0d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:54.352636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d1b6a-c2dd-4def-94e7-ab0e6a4d0d02 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:54.354828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 20/35] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:47:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:54.356119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960ac86-c345-434c-a712-558d473ffd14 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.356473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960ac86-c345-434c-a712-558d473ffd14 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.356760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960ac86-c345-434c-a712-558d473ffd14 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.358553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 21/36] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:54.361162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960ac86-c345-434c-a712-558d473ffd14 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.381768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176e16-45e3-4dea-8ea3-ef8e03ffd0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:54.382629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176e16-45e3-4dea-8ea3-ef8e03ffd0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.382926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176e16-45e3-4dea-8ea3-ef8e03ffd0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.383218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176e16-45e3-4dea-8ea3-ef8e03ffd0f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.395424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176e16-45e3-4dea-8ea3-ef8e03ffd0f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:54.397005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176e16-45e3-4dea-8ea3-ef8e03ffd0f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-33176e16-45e3-4dea-8ea3-ef8e03ffd0f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:47:54.416204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:47:54.417196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:47:54.418017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:47:54.418017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:47:54.418017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:47:54.418017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:47:54.418260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 16/37] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:47:54.419488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c41fd-a1a8-4541-bda4-06e5080bfe91 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.419786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c41fd-a1a8-4541-bda4-06e5080bfe91 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.420070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c41fd-a1a8-4541-bda4-06e5080bfe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.439076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-aa6c41fd-a1a8-4541-bda4-06e5080bfe91 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:54.440625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa6c41fd-a1a8-4541-bda4-06e5080bfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:54.487818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960ac86-c345-434c-a712-558d473ffd14 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:54.509036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:54.519932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 17/38] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:47:54.521239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74415-1a5c-4e9f-b245-636ba9541f41 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.521531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74415-1a5c-4e9f-b245-636ba9541f41 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.521812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74415-1a5c-4e9f-b245-636ba9541f41 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.523112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 18/39] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:54.523801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e74415-1a5c-4e9f-b245-636ba9541f41 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.543519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fb18e-3fa8-42f2-b224-8374747d9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:54.544457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb18e-3fa8-42f2-b224-8374747d9d1b None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.544737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb18e-3fa8-42f2-b224-8374747d9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.545015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb18e-3fa8-42f2-b224-8374747d9d1b None admin] PATH_INFO: `/v3/domains/default/users/0996f80baf904a69852b0b6c8fb6bc6f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.547380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fb18e-3fa8-42f2-b224-8374747d9d1b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0996f80baf904a69852b0b6c8fb6bc6f, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:54.548875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fb18e-3fa8-42f2-b224-8374747d9d1b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:54.564894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 22/40] 10.222.0.58 () {58 vars in 1361 bytes} [Fri Jun 3 12:47:54 2022] PUT /identity/v3/domains/default/users/0996f80baf904a69852b0b6c8fb6bc6f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:47:54.566146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15a54-5752-4d0b-8d93-2f3d28fe9ad1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.566463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15a54-5752-4d0b-8d93-2f3d28fe9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.566754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15a54-5752-4d0b-8d93-2f3d28fe9ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.585349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-36b15a54-5752-4d0b-8d93-2f3d28fe9ad1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:54.586655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-36b15a54-5752-4d0b-8d93-2f3d28fe9ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:54.589118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:54.649866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e74415-1a5c-4e9f-b245-636ba9541f41 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:54.668325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 23/41] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:47:54.669017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b15a54-5752-4d0b-8d93-2f3d28fe9ad1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.695409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:54.696106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.696381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.696666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.697411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:47:54.697720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:54.699416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:54.711820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 19/42] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:54.712588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.778086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:54.799010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b15a54-5752-4d0b-8d93-2f3d28fe9ad1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:54.828228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c6843-0228-459e-854a-dcc59db9a334 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:54.839069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:54.839880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.840167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.840452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.841755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:54.843180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:54.845006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 24/43] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:47:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:54.845565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.859660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:54.866776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:54.868147 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:54.868464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:54.868750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:54.869908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:54.871935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:54.894209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 20/44] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 3 12:47:54 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:47:54.894209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:54.974774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb983b-b176-4248-b3d9-bb573b0f34fb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:55.020795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc148d-1cfa-4aff-8000-67d50ef9ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:55.021579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc148d-1cfa-4aff-8000-67d50ef9ec8d None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:55.021807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc148d-1cfa-4aff-8000-67d50ef9ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:55.022090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc148d-1cfa-4aff-8000-67d50ef9ec8d None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:55.022946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc148d-1cfa-4aff-8000-67d50ef9ec8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:55.024494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc148d-1cfa-4aff-8000-67d50ef9ec8d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:55.039723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a7f8d-bc90-4ccf-88ba-eabf8141f0a1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:55.057971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:55.077651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 25/45] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:47:54 2022] POST /identity/v3/projects => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:47:55.094165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fecdc2-0b0d-4840-b3d3-41e338a3f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:55.094165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecdc2-0b0d-4840-b3d3-41e338a3f352 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:55.094165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecdc2-0b0d-4840-b3d3-41e338a3f352 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:55.094165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecdc2-0b0d-4840-b3d3-41e338a3f352 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:55.094571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fecdc2-0b0d-4840-b3d3-41e338a3f352 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:55.095650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fecdc2-0b0d-4840-b3d3-41e338a3f352 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:55.132974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 21/46] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:47:54 2022] POST /identity/v3/projects => generated 312 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:47:56.839555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6505-8db8-42d0-8f69-29bedb59494a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:56.840068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6505-8db8-42d0-8f69-29bedb59494a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:56.840068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6505-8db8-42d0-8f69-29bedb59494a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:56.841619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 26/47] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:56.846764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb848ec-88da-4da4-b219-f78af023c147 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:56.847201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb848ec-88da-4da4-b219-f78af023c147 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:56.847342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb848ec-88da-4da4-b219-f78af023c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:56.864915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8cb848ec-88da-4da4-b219-f78af023c147 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:56.866152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8cb848ec-88da-4da4-b219-f78af023c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:56.935639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 22/48] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:47:56.960248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab6505-8db8-42d0-8f69-29bedb59494a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:57.020435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:57.064985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab6505-8db8-42d0-8f69-29bedb59494a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:57.100277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:57.101001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.101290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.101576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.114201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:47:57.122663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:47:57.123627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:47:57.124629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 27/49] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:47:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:47:57.130293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb848ec-88da-4da4-b219-f78af023c147 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:57.231081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:57.238895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb848ec-88da-4da4-b219-f78af023c147 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:57.285428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b619ca-8f23-45e9-92da-347a82736e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:57.286723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b619ca-8f23-45e9-92da-347a82736e81 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.287019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b619ca-8f23-45e9-92da-347a82736e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.287293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b619ca-8f23-45e9-92da-347a82736e81 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.288054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b619ca-8f23-45e9-92da-347a82736e81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:47:57.288354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b619ca-8f23-45e9-92da-347a82736e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:57.289827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b619ca-8f23-45e9-92da-347a82736e81 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:57.303505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 23/50] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:57.310676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:57.415335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dd027-a4cb-49c5-a690-173f3f305d10 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:57.433230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:57.451541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:57.452433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.452720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.452996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] PATH_INFO: `/v3/users/0996f80baf904a69852b0b6c8fb6bc6f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.454243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] RBAC: Authorizing `identity:get_user(user_id=0996f80baf904a69852b0b6c8fb6bc6f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:57.455713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:57.456751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac402a9-6204-4f24-8d7d-9c64e65108ca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.457047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac402a9-6204-4f24-8d7d-9c64e65108ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.457337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac402a9-6204-4f24-8d7d-9c64e65108ca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.457468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 28/51] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:47:57 2022] GET /identity/v3/users/0996f80baf904a69852b0b6c8fb6bc6f => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:57.458766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 24/52] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:47:57.462473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:57.463928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe821a4-c25d-4168-8810-22737945ce4f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.464397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe821a4-c25d-4168-8810-22737945ce4f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.464688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe821a4-c25d-4168-8810-22737945ce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.481046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bfe821a4-c25d-4168-8810-22737945ce4f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:47:57.482305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bfe821a4-c25d-4168-8810-22737945ce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:47:57.550917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 25/53] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:47:57.567134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd681cf-d041-4a8d-99a2-b304d1f2394f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:57.573779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe821a4-c25d-4168-8810-22737945ce4f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:57.600907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:57.601709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.601996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.602302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.603514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:57.605066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:57.606719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 29/54] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:47:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:47:57.612450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:57.656371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:57.667058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:47:57.672564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe821a4-c25d-4168-8810-22737945ce4f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:57.706643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:57.707448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.707728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.708003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.709179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:57.710674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:57.712286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 26/55] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:47:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:47:57.714893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9ced6-7044-4e4b-ba19-4ce6d54d9abe None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:57.717904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:47:57.749275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072c20-ae60-4fa2-9c9f-4d4aedfd65c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:57.749949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072c20-ae60-4fa2-9c9f-4d4aedfd65c0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.750275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072c20-ae60-4fa2-9c9f-4d4aedfd65c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.750562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072c20-ae60-4fa2-9c9f-4d4aedfd65c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.751404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072c20-ae60-4fa2-9c9f-4d4aedfd65c0 None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.domain.id=default, user.id=0996f80baf904a69852b0b6c8fb6bc6f) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:47:57.751723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072c20-ae60-4fa2-9c9f-4d4aedfd65c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:57.753193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072c20-ae60-4fa2-9c9f-4d4aedfd65c0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:57.761227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 30/56] 10.222.0.58 () {56 vars in 1322 bytes} [Fri Jun 3 12:47:57 2022] GET /identity/v3/role_assignments?user.id=0996f80baf904a69852b0b6c8fb6bc6f&scope.domain.id=default&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:47:57.826133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9740f-6f87-41d5-a043-1bbf256159fc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:47:57.865847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ebe84-645a-48ff-bfd9-587c0412fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:47:57.866593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ebe84-645a-48ff-bfd9-587c0412fb58 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:47:57.866831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ebe84-645a-48ff-bfd9-587c0412fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:47:57.867111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ebe84-645a-48ff-bfd9-587c0412fb58 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:47:57.868174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ebe84-645a-48ff-bfd9-587c0412fb58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:47:57.869664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ebe84-645a-48ff-bfd9-587c0412fb58 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:47:57.902419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 27/57] 10.222.0.58 () {60 vars in 1140 bytes} [Fri Jun 3 12:47:57 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:48:00.148006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf03e-712b-4695-be59-e1d79f39eaba None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:00.148899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf03e-712b-4695-be59-e1d79f39eaba None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:00.148899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf03e-712b-4695-be59-e1d79f39eaba None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:00.151365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 31/58] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:00.156785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4c2f6-6098-4de0-a9b0-67deecdf1029 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:00.157215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4c2f6-6098-4de0-a9b0-67deecdf1029 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:00.157311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4c2f6-6098-4de0-a9b0-67deecdf1029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:00.170479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:00.176247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-35f4c2f6-6098-4de0-a9b0-67deecdf1029 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:00.177640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-35f4c2f6-6098-4de0-a9b0-67deecdf1029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:00.249619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 28/59] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:00.274779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf03e-712b-4695-be59-e1d79f39eaba None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:00.380182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf03e-712b-4695-be59-e1d79f39eaba None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:00.397521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:00.417746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adabd6-c3df-4638-bf46-faac424d9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:00.418520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adabd6-c3df-4638-bf46-faac424d9647 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:00.418878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adabd6-c3df-4638-bf46-faac424d9647 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:00.419147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adabd6-c3df-4638-bf46-faac424d9647 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:00.420481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adabd6-c3df-4638-bf46-faac424d9647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:00.422027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adabd6-c3df-4638-bf46-faac424d9647 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:00.423693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 32/60] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:00.429505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4c2f6-6098-4de0-a9b0-67deecdf1029 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:00.532579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4c2f6-6098-4de0-a9b0-67deecdf1029 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:00.567914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9bbf-136f-4f99-9dce-1e2f9b37ec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:00.568592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9bbf-136f-4f99-9dce-1e2f9b37ec76 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:00.568883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9bbf-136f-4f99-9dce-1e2f9b37ec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:00.569167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9bbf-136f-4f99-9dce-1e2f9b37ec76 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:00.569883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb9bbf-136f-4f99-9dce-1e2f9b37ec76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:00.571505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb9bbf-136f-4f99-9dce-1e2f9b37ec76 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:00.582578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:00.600472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 29/61] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:00 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:03.850445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae76a7-eae1-4d35-884e-86b4ec8178dc None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:03.851431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae76a7-eae1-4d35-884e-86b4ec8178dc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:03.851955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae76a7-eae1-4d35-884e-86b4ec8178dc None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:03.853554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 33/62] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:03.859296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877e2e9-990c-47ab-9657-b968aac10ce2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:03.860141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877e2e9-990c-47ab-9657-b968aac10ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:03.860629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877e2e9-990c-47ab-9657-b968aac10ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:03.887340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0877e2e9-990c-47ab-9657-b968aac10ce2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:03.888926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0877e2e9-990c-47ab-9657-b968aac10ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:03.981249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 30/63] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:04.027984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae76a7-eae1-4d35-884e-86b4ec8178dc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.071088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6df1-e02c-4027-9522-1969d0b30722 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.071768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6df1-e02c-4027-9522-1969d0b30722 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.072145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6df1-e02c-4027-9522-1969d0b30722 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.074663 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 31/64] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:04.081776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bf356-81da-4b58-a5af-0d89bd398817 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.082051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bf356-81da-4b58-a5af-0d89bd398817 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.082375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bf356-81da-4b58-a5af-0d89bd398817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.107758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3b1bf356-81da-4b58-a5af-0d89bd398817 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:04.108892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b1bf356-81da-4b58-a5af-0d89bd398817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:04.178695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 32/65] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:04.206733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae76a7-eae1-4d35-884e-86b4ec8178dc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:04.223973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bf356-81da-4b58-a5af-0d89bd398817 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.263528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:04.264387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.264667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.265098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.288300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:04.306542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:04.309352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:04.310216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:04.310974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:04.311550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 34/66] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:04.319526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.343078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bf356-81da-4b58-a5af-0d89bd398817 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:04.390042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:04.391526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.392041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.392455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.393123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:04.406791 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:04.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:04.416048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:04.417030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:04.419163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 33/67] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:04.434133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.500896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a44c1-b61b-4d58-a605-2db077b3fc7b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:04.536107 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef05da-3884-4c3b-8ffb-d4e80c897dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:04.537059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef05da-3884-4c3b-8ffb-d4e80c897dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.537491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef05da-3884-4c3b-8ffb-d4e80c897dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.537914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef05da-3884-4c3b-8ffb-d4e80c897dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.538865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef05da-3884-4c3b-8ffb-d4e80c897dc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:04.539320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef05da-3884-4c3b-8ffb-d4e80c897dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:04.540884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef05da-3884-4c3b-8ffb-d4e80c897dc6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:04.551058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 35/68] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:04.552752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122bd93-801d-49bb-85be-64932dca4c8c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.553224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122bd93-801d-49bb-85be-64932dca4c8c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.553690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122bd93-801d-49bb-85be-64932dca4c8c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.555083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 36/69] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:04.557385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122bd93-801d-49bb-85be-64932dca4c8c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.585999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975d64-fc34-4e02-a8f0-0f99544fb3e4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:04.601897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:04.628829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ac3c6-1373-4da8-a3be-990c9aecf6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:04.629800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac3c6-1373-4da8-a3be-990c9aecf6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.630088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac3c6-1373-4da8-a3be-990c9aecf6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.630417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac3c6-1373-4da8-a3be-990c9aecf6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.631177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ac3c6-1373-4da8-a3be-990c9aecf6e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:04.631493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ac3c6-1373-4da8-a3be-990c9aecf6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:04.632953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ac3c6-1373-4da8-a3be-990c9aecf6e3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:04.641725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 34/70] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:04.643164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea01f2-270f-429e-b836-6c658bbf1371 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.643620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea01f2-270f-429e-b836-6c658bbf1371 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.644045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea01f2-270f-429e-b836-6c658bbf1371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.661090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-92ea01f2-270f-429e-b836-6c658bbf1371 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:04.662336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92ea01f2-270f-429e-b836-6c658bbf1371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:04.676886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122bd93-801d-49bb-85be-64932dca4c8c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:04.687853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:04.717283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bb760-c8cf-49ba-a3ee-78e57e850641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:04.718328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bb760-c8cf-49ba-a3ee-78e57e850641 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.718600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bb760-c8cf-49ba-a3ee-78e57e850641 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.718880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bb760-c8cf-49ba-a3ee-78e57e850641 None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.731395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 35/71] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:04.732541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3acb91-4afa-4576-a461-c25ac409e823 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.732839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3acb91-4afa-4576-a461-c25ac409e823 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.733123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3acb91-4afa-4576-a461-c25ac409e823 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.734423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 36/72] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:04.735287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3acb91-4afa-4576-a461-c25ac409e823 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.741256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bb760-c8cf-49ba-a3ee-78e57e850641 None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:04.747044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bb760-c8cf-49ba-a3ee-78e57e850641 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:04.750691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:04.752175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1752f3-bb36-40c7-a52f-62617d045a51 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.752666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1752f3-bb36-40c7-a52f-62617d045a51 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.753173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1752f3-bb36-40c7-a52f-62617d045a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.770506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0a1752f3-bb36-40c7-a52f-62617d045a51 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:04.771720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0a1752f3-bb36-40c7-a52f-62617d045a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:04.838169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 38/74] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:04.839291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1752f3-bb36-40c7-a52f-62617d045a51 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.846899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3acb91-4afa-4576-a461-c25ac409e823 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:04.850049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:04.887478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:04.888357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.888640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.888914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] PATH_INFO: `/v3/users/0996f80baf904a69852b0b6c8fb6bc6f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.890145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] RBAC: Authorizing `identity:get_user(user_id=0996f80baf904a69852b0b6c8fb6bc6f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:04.891627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:04.893326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/users/0996f80baf904a69852b0b6c8fb6bc6f => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:04.894060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:04.935139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:04.941502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1752f3-bb36-40c7-a52f-62617d045a51 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:04.975569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:04.976238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:04.976524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:04.976789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:04.998418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96bcba-9038-4b0d-8989-8c99d4ec2bfe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.034439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f29ee-01b4-4e3f-ae5a-10140eabdedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.035257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f29ee-01b4-4e3f-ae5a-10140eabdedf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.035547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f29ee-01b4-4e3f-ae5a-10140eabdedf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.035829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f29ee-01b4-4e3f-ae5a-10140eabdedf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.046979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f29ee-01b4-4e3f-ae5a-10140eabdedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:05.048511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.050004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b79f29ee-01b4-4e3f-ae5a-10140eabdedf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:05.055048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:05.055920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:05.056673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 38/76] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:05.057652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba8f3-854a-490b-8d3c-53466a401b61 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.057939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba8f3-854a-490b-8d3c-53466a401b61 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.058249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba8f3-854a-490b-8d3c-53466a401b61 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.059502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 39/77] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:05.062634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba8f3-854a-490b-8d3c-53466a401b61 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.094960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.152510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.159690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 39/78] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:05.164516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.167845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba8f3-854a-490b-8d3c-53466a401b61 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.202364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.203170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.203455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.203737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.213953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:05.221674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:05.222535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:05.223311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 40/79] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:05.223933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.268568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dea46-efa0-4a30-8347-5a80cb7a3558 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.303749 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.304425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.304714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.304996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.316853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.326802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b4aa-5112-4630-ad15-643a46e9d555 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.361347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5a5a3-9d69-44be-8153-6ffeacb05024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.362031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5a5a3-9d69-44be-8153-6ffeacb05024 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.362357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5a5a3-9d69-44be-8153-6ffeacb05024 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.362641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5a5a3-9d69-44be-8153-6ffeacb05024 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.363392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5a5a3-9d69-44be-8153-6ffeacb05024 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:05.363706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5a5a3-9d69-44be-8153-6ffeacb05024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.365120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5a5a3-9d69-44be-8153-6ffeacb05024 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.369389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.373685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 41/80] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:05.375012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217bd58-9e01-4aeb-a1fb-fbd40c4e1a21 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.375307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217bd58-9e01-4aeb-a1fb-fbd40c4e1a21 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.375592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217bd58-9e01-4aeb-a1fb-fbd40c4e1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.380862 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.382389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.392059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6217bd58-9e01-4aeb-a1fb-fbd40c4e1a21 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:05.393279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6217bd58-9e01-4aeb-a1fb-fbd40c4e1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:05.462497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 42/81] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:05.463363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217bd58-9e01-4aeb-a1fb-fbd40c4e1a21 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.488043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 40/82] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:05.488043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.550721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.567671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217bd58-9e01-4aeb-a1fb-fbd40c4e1a21 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.578665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.585086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ac18-588b-472a-ac95-57df4415e8e0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.601827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.602746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.603034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.603311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.604565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.606024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.607774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 43/83] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:05.608541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.625591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.626301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.626588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.626864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.627609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:05.627922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.629314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.637709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 41/84] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:05.638605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.710379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb1d1-4bc1-4121-992a-8be87073bbb2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.737867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2979-0b99-4702-809c-c0b646fc5146 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.745772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.746694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.746977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.747601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.748830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.750326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.751959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 44/85] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:05.752716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.773979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.777318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.778389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.778685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.778969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.780187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.781663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.783348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 42/86] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:05.784117 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.812518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:05.856646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb585-5ee6-4182-85ce-40e830b6d2aa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.886541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959732-6be9-44d4-bfe4-276bff94da26 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:05.890096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.890992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.891280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.891554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.892735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.894237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.895938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 45/87] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:05.896690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.925035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:05.925693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:05.925977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:05.926318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:05.927138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=5d97e373a7e641b583ccdd262a905729) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:05.927461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:05.928909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:05.935123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 43/88] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/role_assignments?user.id=5d97e373a7e641b583ccdd262a905729&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:05.935795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:05.993186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:06.008274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a37391-d012-4257-8dc3-b6aa1310f37b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.053478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.054682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:06.055092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.055387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.055672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.057044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.058816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.065514 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 46/89] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:06.065514 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:06.071947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92129c9a-f0f3-472c-bfd7-5b5473c3dc83 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.111119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.111799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.112095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.112379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.175112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e99b-9396-4c15-9bb6-1636eaa2d2c2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.188896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.190533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.211327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.212063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.212357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.212639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.213352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.215197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.238532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 47/90] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:06 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:06.251378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:06.282491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:06.308743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:06.323970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 44/91] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:06.325677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:06.406193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c32d-9b49-48a5-b8ed-a95c55d1e132 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.459504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.460729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.461553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.462329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.463612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=0996f80baf904a69852b0b6c8fb6bc6f) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:06.464823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.466860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.467284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768397f3-f93d-4c3e-8888-f50ca5e482de None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.480031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 48/92] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:06 2022] GET /identity/v3/role_assignments?user.id=0996f80baf904a69852b0b6c8fb6bc6f&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:06.482140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:06.510438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.511368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.511922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.512281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.603092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:06.614670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:06.632761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.634681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.638634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948b86-3645-4968-99a7-b06daa3bfc96 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.681108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.682504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.682999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.683518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.685024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.687875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.690050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 49/93] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:06 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:06.697433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:06.775391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 45/94] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:06.781038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:06.836888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d266a-a077-43fa-a287-c48ec9b8580d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.884336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.885399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.886400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.886951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.888084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] RBAC: Adding query filter params (role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=5d97e373a7e641b583ccdd262a905729) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:06.888669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.890376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.897283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 50/95] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:06 2022] GET /identity/v3/role_assignments?user.id=5d97e373a7e641b583ccdd262a905729&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=66551becb6cc4504bfbd74555d898a06 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:06.908900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:06.919827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a19319-b72b-4ee8-b2e2-c364a0b4e27d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:06.960576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90352a-6428-48ec-a8ef-0f543b006efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:06.961464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90352a-6428-48ec-a8ef-0f543b006efe None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:06.961752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90352a-6428-48ec-a8ef-0f543b006efe None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:06.962030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90352a-6428-48ec-a8ef-0f543b006efe None admin] PATH_INFO: `/v3/projects/4f45b13e2f3c466895ecbec1eff6b105` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:06.963406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90352a-6428-48ec-a8ef-0f543b006efe None admin] RBAC: Authorizing `identity:get_project(project_id=4f45b13e2f3c466895ecbec1eff6b105)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:06.965115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90352a-6428-48ec-a8ef-0f543b006efe None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:06.966949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 46/96] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:06 2022] GET /identity/v3/projects/4f45b13e2f3c466895ecbec1eff6b105 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:06.973122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:07.006532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:07.087055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fde86b-515e-4287-a1d8-b25a36925836 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:07.127502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ebdf8-97ca-43da-90fe-017683533d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:07.128190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ebdf8-97ca-43da-90fe-017683533d06 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:07.128473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ebdf8-97ca-43da-90fe-017683533d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:07.128750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ebdf8-97ca-43da-90fe-017683533d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:07.129593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ebdf8-97ca-43da-90fe-017683533d06 None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=4f45b13e2f3c466895ecbec1eff6b105, user.id=5d97e373a7e641b583ccdd262a905729) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:07.129928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ebdf8-97ca-43da-90fe-017683533d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:07.131451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ebdf8-97ca-43da-90fe-017683533d06 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:07.138668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 51/97] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:06 2022] GET /identity/v3/role_assignments?user.id=5d97e373a7e641b583ccdd262a905729&scope.project.id=4f45b13e2f3c466895ecbec1eff6b105&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:08.720010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260acdd-c048-40d3-a256-378be933ee52 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:08.720549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260acdd-c048-40d3-a256-378be933ee52 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:08.720549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260acdd-c048-40d3-a256-378be933ee52 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:08.722221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 47/98] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:08.727706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021575d-4398-459c-9d4d-dfb18a447b31 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:08.728107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021575d-4398-459c-9d4d-dfb18a447b31 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:08.728286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021575d-4398-459c-9d4d-dfb18a447b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:08.747128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e021575d-4398-459c-9d4d-dfb18a447b31 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:08.748340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e021575d-4398-459c-9d4d-dfb18a447b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:08.819734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 52/99] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:08.842272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260acdd-c048-40d3-a256-378be933ee52 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:08.949636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260acdd-c048-40d3-a256-378be933ee52 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:08.985104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:08.985920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:08.986240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:08.986526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:08.997393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:09.005205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:09.006105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:09.007352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 48/100] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:09.012451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021575d-4398-459c-9d4d-dfb18a447b31 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:09.014721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:09.115260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021575d-4398-459c-9d4d-dfb18a447b31 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:09.152589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:09.153377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:09.153671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:09.153962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:09.154748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:09.155061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:09.156737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:09.165565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 53/101] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:09.171658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:09.191997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:09.279129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e966-cd63-4e20-a6ff-52cf0cdf8622 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:09.316489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:09.317399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:09.317717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:09.318004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:09.319415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:09.320895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:09.322982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 49/102] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:09 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:09.332633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:09.407296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:09.447495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67a0d-ce9a-4a84-91a8-442b0e382b28 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:09.489102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976be646-dc5f-4a2a-babe-7c842159e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:09.490039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be646-dc5f-4a2a-babe-7c842159e57e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:09.490362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be646-dc5f-4a2a-babe-7c842159e57e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:09.490648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be646-dc5f-4a2a-babe-7c842159e57e None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:09.491862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976be646-dc5f-4a2a-babe-7c842159e57e None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:09.493673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976be646-dc5f-4a2a-babe-7c842159e57e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:09.495501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 54/103] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:09 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:09.503023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:09.619161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:09.634077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075ea5-a63b-4db5-9d66-e3ef23232050 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:09.686419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac788a-108d-492f-8be8-4840cdd92140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:09.687273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac788a-108d-492f-8be8-4840cdd92140 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:09.687565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac788a-108d-492f-8be8-4840cdd92140 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:09.687850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac788a-108d-492f-8be8-4840cdd92140 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/5d97e373a7e641b583ccdd262a905729/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:09.689945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac788a-108d-492f-8be8-4840cdd92140 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbf23601e34aa3b5f779f7742e321c, user_id=5d97e373a7e641b583ccdd262a905729, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:09.691517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac788a-108d-492f-8be8-4840cdd92140 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:09.724441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 50/104] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:09 2022] PUT /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/5d97e373a7e641b583ccdd262a905729/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:10.109374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5488-3370-4200-a79b-e83138f29031 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.109940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5488-3370-4200-a79b-e83138f29031 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.109940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5488-3370-4200-a79b-e83138f29031 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.111569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 55/105] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:10.125839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bad92-6a7c-4124-9c37-cb32f95de7b2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.126166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bad92-6a7c-4124-9c37-cb32f95de7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.126460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bad92-6a7c-4124-9c37-cb32f95de7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.147340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-087bad92-6a7c-4124-9c37-cb32f95de7b2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:10.148568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-087bad92-6a7c-4124-9c37-cb32f95de7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:10.158629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78bd94-f8b6-464e-8d50-b16f2b638f5a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.158922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78bd94-f8b6-464e-8d50-b16f2b638f5a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.159204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78bd94-f8b6-464e-8d50-b16f2b638f5a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.160718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 56/106] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:10.170000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39174-d2c4-4d57-9774-9d8774a98dc3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.170323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39174-d2c4-4d57-9774-9d8774a98dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.170616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39174-d2c4-4d57-9774-9d8774a98dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.201168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-29b39174-d2c4-4d57-9774-9d8774a98dc3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:10.202452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-29b39174-d2c4-4d57-9774-9d8774a98dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:10.280519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 51/107] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:10.303934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bad92-6a7c-4124-9c37-cb32f95de7b2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:10.360112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 57/108] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:10.361455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f547-bb93-4c1b-aee6-de7cd604abfa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.361754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f547-bb93-4c1b-aee6-de7cd604abfa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.362038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f547-bb93-4c1b-aee6-de7cd604abfa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.363840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 58/109] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:10.379928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f8e4-8329-43bc-b7f8-3cda80b5dbbf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.380218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f8e4-8329-43bc-b7f8-3cda80b5dbbf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.380509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f8e4-8329-43bc-b7f8-3cda80b5dbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.410234 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0002f8e4-8329-43bc-b7f8-3cda80b5dbbf None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:10.411509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0002f8e4-8329-43bc-b7f8-3cda80b5dbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:10.425707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:10.452879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bad92-6a7c-4124-9c37-cb32f95de7b2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:10.489430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:10.490369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.490719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.491103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.492408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:10.493878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:10.494487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:10.496497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 52/110] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:10.497433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:10.514705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 59/111] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:10.516528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1b14-3849-493e-9e25-07e7a9e5b72f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.517063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1b14-3849-493e-9e25-07e7a9e5b72f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.517541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1b14-3849-493e-9e25-07e7a9e5b72f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.519342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 60/112] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:10.520272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1b14-3849-493e-9e25-07e7a9e5b72f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:10.623119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becf3d0-9313-4dfd-8acf-91cf2361a7e2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:10.651357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1b14-3849-493e-9e25-07e7a9e5b72f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:10.658393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9d14-3116-493d-8fd5-98db4fba51bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:10.659213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9d14-3116-493d-8fd5-98db4fba51bf None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.659502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9d14-3116-493d-8fd5-98db4fba51bf None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.659779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9d14-3116-493d-8fd5-98db4fba51bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.671521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd9d14-3116-493d-8fd5-98db4fba51bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d3dd9d14-3116-493d-8fd5-98db4fba51bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:10.679689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:10.680563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:10.681324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 53/113] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:10.682710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b297488-4ab5-437d-8472-e97d7d63ad26 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.682710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b297488-4ab5-437d-8472-e97d7d63ad26 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.682875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b297488-4ab5-437d-8472-e97d7d63ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.688444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:10.696297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:10.696975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.697348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.697547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.698483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:10.700183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:10.701298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8b297488-4ab5-437d-8472-e97d7d63ad26 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:10.702534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8b297488-4ab5-437d-8472-e97d7d63ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:10.735036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 61/114] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:48:10 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:10.736172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:10.796665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 54/115] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:10.810249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b805e4-73aa-425b-93a6-81fc824c99fc None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.810249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b805e4-73aa-425b-93a6-81fc824c99fc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.810249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b805e4-73aa-425b-93a6-81fc824c99fc None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.810249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 55/116] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:10.810249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b805e4-73aa-425b-93a6-81fc824c99fc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:10.826478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:10.895222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c199-eb9a-4e0b-a9c6-c64a3ceba3ac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:10.936157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487cf17-a4d2-4856-93dd-0537cd45cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:10.937005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487cf17-a4d2-4856-93dd-0537cd45cc3d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.937293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487cf17-a4d2-4856-93dd-0537cd45cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.937572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487cf17-a4d2-4856-93dd-0537cd45cc3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.938662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b805e4-73aa-425b-93a6-81fc824c99fc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:10.950312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487cf17-a4d2-4856-93dd-0537cd45cc3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f487cf17-a4d2-4856-93dd-0537cd45cc3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:10.959153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:10.960046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:10.960807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 62/117] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:10.962195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42891-80bc-4a32-b0c3-c9262a834f6c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.962195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42891-80bc-4a32-b0c3-c9262a834f6c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.962362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42891-80bc-4a32-b0c3-c9262a834f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.981658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c4e42891-80bc-4a32-b0c3-c9262a834f6c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:10.982906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4e42891-80bc-4a32-b0c3-c9262a834f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:10.983739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:10.984429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:10.984716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:10.985002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:10.986365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:10.986365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:10.987616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:10.989170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:10.998645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 56/118] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:10.999506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.065034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 63/119] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:11.066330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e42891-80bc-4a32-b0c3-c9262a834f6c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.103849 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:11.133719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65def8-c503-4656-b7fa-5913d0f0b344 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.170755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.171529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.171815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.172092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.184059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:11.187682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e42891-80bc-4a32-b0c3-c9262a834f6c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:11.191976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:11.192812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:11.194223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 57/120] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:11.199634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.228661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.229640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.229965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.230253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.231466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:11.231790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.233745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.246377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 64/121] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.250654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.269709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:11.322637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2516227-8ba4-427f-875c-f7e52d7f273f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.369456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.371428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:11.372660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.373190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.373533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.375051 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.377816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.378807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5115b-7713-439c-a826-b8df9e8dd752 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.379870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 58/122] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.381127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.421452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.422737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.423344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.423820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.437311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:11.448374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:11.449258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:11.450039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:11.451553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 65/123] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:11.454898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.521911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43d8b2-18c4-41b7-a587-19d69578882b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.553072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:11.568566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.569817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.570363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.571060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.572403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:11.572918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.574903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.587488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 59/124] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.588610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.593497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f2ac1-c5c4-45aa-a0fb-fb4b1ffe96d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.630549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.631516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.631806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.632087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.633302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.635290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.637214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 66/125] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.641826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.666716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:11.729478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828c525-1de2-475a-acc2-a26935b38c61 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.754311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef29b9-b887-420f-b2f9-1da4794c2a85 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.775855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.777451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.777984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.778750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] PATH_INFO: `/v3/projects/4f45b13e2f3c466895ecbec1eff6b105` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.780883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=4f45b13e2f3c466895ecbec1eff6b105)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.783560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.786474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 60/126] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/projects/4f45b13e2f3c466895ecbec1eff6b105 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.787533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.790582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.792204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.792204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.792204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.793450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:11.793769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.795247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.804188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 67/127] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.810313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.849539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:11.899754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e2e91-734d-4fce-8cd9-d0c3598b3cc0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.905916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:11.919562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a481a32-eade-413c-9bed-3f66f4cf4147 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:11.939421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.940687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.941183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.941659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] PATH_INFO: `/v3/users/0996f80baf904a69852b0b6c8fb6bc6f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.943229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] RBAC: Authorizing `identity:get_user(user_id=0996f80baf904a69852b0b6c8fb6bc6f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.944991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.947005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 61/128] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/users/0996f80baf904a69852b0b6c8fb6bc6f => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.947965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:11.962005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:11.962801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:11.963092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:11.963373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:11.971079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:11.972693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:11.980104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 68/129] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:11.980104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:12.074722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d88d-ac50-4f26-a34c-a7589eda6d16 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:12.081956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1ed6c-3355-4569-a8ba-d165e2b7eb9c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:12.107622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:12.123898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:12.124847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.125132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.125410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] PATH_INFO: `/v3/users/cdb4b9b6d3454623bc4e3da9f57229bb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.126065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:12.127366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.128207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.129759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] PATH_INFO: `/v3/projects/4f45b13e2f3c466895ecbec1eff6b105/users/5d97e373a7e641b583ccdd262a905729/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.132226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f45b13e2f3c466895ecbec1eff6b105, user_id=5d97e373a7e641b583ccdd262a905729, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:12.133956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:12.141762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] RBAC: Authorizing `identity:get_user(user_id=cdb4b9b6d3454623bc4e3da9f57229bb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:12.144565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:12.146662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 69/130] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:11 2022] GET /identity/v3/users/cdb4b9b6d3454623bc4e3da9f57229bb => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:12.151945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:12.153813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 62/131] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:11 2022] PUT /identity/v3/projects/4f45b13e2f3c466895ecbec1eff6b105/users/5d97e373a7e641b583ccdd262a905729/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:12.154974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:12.170274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:12.336990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aea49-e431-412f-8e92-52f45a487c00 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:12.341300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d733-9ef5-49c7-8d5b-cd47f21020e2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:12.380163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:12.381436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.381927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.382459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.383919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:12.385596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:12.387973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 70/132] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:12 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:12.389060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:12.423156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:12.423824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.424115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.424392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/5d97e373a7e641b583ccdd262a905729/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.427818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbf23601e34aa3b5f779f7742e321c, user_id=5d97e373a7e641b583ccdd262a905729, role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:12.429313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:12.447087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 63/133] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:12 2022] PUT /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/5d97e373a7e641b583ccdd262a905729/roles/66551becb6cc4504bfbd74555d898a06 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:12.448100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:12.487135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:12.502864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:12.509702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce47f-845e-4eda-9815-2ea57d82485a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:12.548260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:12.549085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.549478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.549862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.608794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78796eb-9b57-47ba-927b-b5be12d0d4b6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:12.640605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:12.643113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:12.656934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e4406-553a-4274-aead-5eec970f51ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:12.657853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e4406-553a-4274-aead-5eec970f51ed None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.658167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e4406-553a-4274-aead-5eec970f51ed None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.658495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e4406-553a-4274-aead-5eec970f51ed None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/0996f80baf904a69852b0b6c8fb6bc6f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.660516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e4406-553a-4274-aead-5eec970f51ed None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbf23601e34aa3b5f779f7742e321c, user_id=0996f80baf904a69852b0b6c8fb6bc6f, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:12.662005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e4406-553a-4274-aead-5eec970f51ed None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:12.677772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 64/134] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:12 2022] PUT /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/0996f80baf904a69852b0b6c8fb6bc6f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:12.681944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925724b6-b4f1-4da7-a512-7f2e32c9a84b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.681944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925724b6-b4f1-4da7-a512-7f2e32c9a84b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.681944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925724b6-b4f1-4da7-a512-7f2e32c9a84b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.681944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 65/135] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:12.688099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8a39-b5e5-43ca-a4d2-a8e567d0e6a7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:12.688410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8a39-b5e5-43ca-a4d2-a8e567d0e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:12.688669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8a39-b5e5-43ca-a4d2-a8e567d0e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:12.709255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-21cf8a39-b5e5-43ca-a4d2-a8e567d0e6a7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:12.710477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-21cf8a39-b5e5-43ca-a4d2-a8e567d0e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:12.774018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:12.799707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 66/136] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:12.811396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 71/137] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:12.817581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8a39-b5e5-43ca-a4d2-a8e567d0e6a7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:12.860456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:12.879566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:13.021553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8a39-b5e5-43ca-a4d2-a8e567d0e6a7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:13.056180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc1864-d69e-41ed-a3f3-b81a3e798797 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:13.093699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:13.094950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:13.095417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:13.095892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:13.097547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:13.099303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:13.102985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 67/138] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:12 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:13.111145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:13.131383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:13.132622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:13.133081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:13.133527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:13.153930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:13.163915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:13.164771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:13.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:13.171473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 72/139] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:13.184406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:13.256339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:13.308166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:13.311249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c3923-fc04-4203-be13-83a4234a95db None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:13.366239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b1757-e86f-4200-bdd7-ea87c3d7d172 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:13.378773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:13.379500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:13.379786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:13.380109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:13.381007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] RBAC: Adding query filter params (role.id=3df06c8b10b2453cb3c7bfa7139b4e20, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=cdb4b9b6d3454623bc4e3da9f57229bb) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:13.381334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:13.382833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:13.392750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 68/140] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:13 2022] GET /identity/v3/role_assignments?user.id=cdb4b9b6d3454623bc4e3da9f57229bb&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=3df06c8b10b2453cb3c7bfa7139b4e20 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:13.427339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9ff1-6291-47f7-9be4-7b03b8c9c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:13.428036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9ff1-6291-47f7-9be4-7b03b8c9c751 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:13.428327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9ff1-6291-47f7-9be4-7b03b8c9c751 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:13.428645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9ff1-6291-47f7-9be4-7b03b8c9c751 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:13.429413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9ff1-6291-47f7-9be4-7b03b8c9c751 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:13.429724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9ff1-6291-47f7-9be4-7b03b8c9c751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:13.435487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9ff1-6291-47f7-9be4-7b03b8c9c751 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:13.444955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 73/141] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:13.451229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:13.492501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9aee-85b6-41bf-ab89-d329049ccf82 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:13.492839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9aee-85b6-41bf-ab89-d329049ccf82 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:13.493079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9aee-85b6-41bf-ab89-d329049ccf82 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:13.494994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 74/142] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:13.500209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fe0d0-abf6-4fc1-8113-2ea1f5faeb21 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:13.500503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fe0d0-abf6-4fc1-8113-2ea1f5faeb21 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:13.500789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fe0d0-abf6-4fc1-8113-2ea1f5faeb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:13.520775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-217fe0d0-abf6-4fc1-8113-2ea1f5faeb21 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:13.523474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-217fe0d0-abf6-4fc1-8113-2ea1f5faeb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:13.683375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 75/143] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:13.701740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509c8a5-0ce7-4d83-939f-c2d9f78833d1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:13.712132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fe0d0-abf6-4fc1-8113-2ea1f5faeb21 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:13.769550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:13.770771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:13.771673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:13.771962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:13.772260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:13.773610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:13.777315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:13.779049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 69/144] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:13 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:13.788667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:13.858173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:13.937688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fe0d0-abf6-4fc1-8113-2ea1f5faeb21 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:13.999076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45090-c982-4c4e-a46a-debadcc5ec61 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:14.009946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:14.010820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:14.011243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:14.011521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:14.018142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:14.018142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:14.018142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 76/145] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:14.024419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:14.086648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:14.087704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:14.088235 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:14.088809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:14.216047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:14.217901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:14.235268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:14.244167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d944e-d5bd-4125-be5a-565ddbca2ccd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:14.263932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:14.310428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:14.312143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:14.312777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:14.314350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:14.316116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:14.318447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:14.362772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 77/146] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:14 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:48:14.382784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 70/147] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:14.389227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:14.501831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d00d-07e8-43f8-b8fe-355d06700003 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:14.540981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220d5de-200e-490d-b960-beb87e4604c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:14.542434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220d5de-200e-490d-b960-beb87e4604c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:14.542989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220d5de-200e-490d-b960-beb87e4604c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:14.543500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220d5de-200e-490d-b960-beb87e4604c4 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:14.545009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220d5de-200e-490d-b960-beb87e4604c4 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:14.546554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220d5de-200e-490d-b960-beb87e4604c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:14.548655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 78/148] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:14 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:14.554985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:14.687888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009cbba-514e-4c1b-98a0-3d80fefeefbb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:14.720351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:14.727473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66731267-25ee-456e-b907-64bb27f63782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:14.728161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731267-25ee-456e-b907-64bb27f63782 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:14.728452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731267-25ee-456e-b907-64bb27f63782 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:14.728733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731267-25ee-456e-b907-64bb27f63782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:14.729634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731267-25ee-456e-b907-64bb27f63782 None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=5d97e373a7e641b583ccdd262a905729) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:14.729956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731267-25ee-456e-b907-64bb27f63782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:14.731453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731267-25ee-456e-b907-64bb27f63782 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:14.738280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 71/149] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:14 2022] GET /identity/v3/role_assignments?user.id=5d97e373a7e641b583ccdd262a905729&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:15.348835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4a19-e947-49ee-9f8a-772861cba3da None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:15.349363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4a19-e947-49ee-9f8a-772861cba3da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:15.349814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4a19-e947-49ee-9f8a-772861cba3da None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:15.351609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 79/150] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:15.357390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dbf70-b1c2-41ec-9920-3dad74474921 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:15.358231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dbf70-b1c2-41ec-9920-3dad74474921 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:15.358682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dbf70-b1c2-41ec-9920-3dad74474921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:15.379001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7f1dbf70-b1c2-41ec-9920-3dad74474921 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:15.380536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7f1dbf70-b1c2-41ec-9920-3dad74474921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:15.460101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 72/151] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:15.484409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4a19-e947-49ee-9f8a-772861cba3da None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:15.513458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:15.605427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4a19-e947-49ee-9f8a-772861cba3da None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:15.647499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:15.648341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:15.648621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:15.648892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:15.661158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:15.669342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:15.670298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:15.671052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 80/152] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:15.677688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dbf70-b1c2-41ec-9920-3dad74474921 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:15.816039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dbf70-b1c2-41ec-9920-3dad74474921 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:15.848262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:15.859944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:15.860553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:15.860837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:15.861116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:15.861879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:15.862214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:15.863609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:15.878575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 73/153] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:15.883849 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:15.990906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:16.025800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133805a-736f-437d-a36c-44307aa4fdd4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:16.067648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54c662-db43-4f4f-b9b8-7681c592f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:16.068542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54c662-db43-4f4f-b9b8-7681c592f2be None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.068826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54c662-db43-4f4f-b9b8-7681c592f2be None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.069110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54c662-db43-4f4f-b9b8-7681c592f2be None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.070812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54c662-db43-4f4f-b9b8-7681c592f2be None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:16.072281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54c662-db43-4f4f-b9b8-7681c592f2be None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:16.075044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 81/154] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:15 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:16.080418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:16.201429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89170e4-1c30-479e-b1e6-29b00469e924 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.201739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89170e4-1c30-479e-b1e6-29b00469e924 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.201904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89170e4-1c30-479e-b1e6-29b00469e924 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.203513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 82/155] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:48:16.209395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39319b-2998-447e-b400-1c7a4f613901 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.209684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39319b-2998-447e-b400-1c7a4f613901 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.209968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39319b-2998-447e-b400-1c7a4f613901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.223859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392abea-5858-4085-a5b3-00d7d8cf8e8c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:16.231992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4b39319b-2998-447e-b400-1c7a4f613901 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:16.233239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4b39319b-2998-447e-b400-1c7a4f613901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:16.279821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6075f5-7911-49a5-8084-315f69fb8b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:16.280564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6075f5-7911-49a5-8084-315f69fb8b84 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.280853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6075f5-7911-49a5-8084-315f69fb8b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.281240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6075f5-7911-49a5-8084-315f69fb8b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.321097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 83/156] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:16.351162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39319b-2998-447e-b400-1c7a4f613901 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:16.377132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:16.396342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6075f5-7911-49a5-8084-315f69fb8b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:16.397823 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6075f5-7911-49a5-8084-315f69fb8b84 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:16.473117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:16.492539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39319b-2998-447e-b400-1c7a4f613901 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:16.569116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88006b4f-4bff-493c-b1bf-7ab3b67e58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:16.569948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88006b4f-4bff-493c-b1bf-7ab3b67e58d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.570258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88006b4f-4bff-493c-b1bf-7ab3b67e58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.570536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88006b4f-4bff-493c-b1bf-7ab3b67e58d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.599076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88006b4f-4bff-493c-b1bf-7ab3b67e58d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:16.611854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 74/157] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:16.613177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372ab42-3cf7-45a7-9689-de27f2882f22 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.613480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372ab42-3cf7-45a7-9689-de27f2882f22 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.613760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372ab42-3cf7-45a7-9689-de27f2882f22 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.615335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 75/158] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:16.616404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b412b64-1382-42ef-ac13-6962500b8af4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.616690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b412b64-1382-42ef-ac13-6962500b8af4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.616967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b412b64-1382-42ef-ac13-6962500b8af4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.619103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 76/159] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-88006b4f-4bff-493c-b1bf-7ab3b67e58d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:16.619221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:16.620011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:16.620899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:16.621477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b412b64-1382-42ef-ac13-6962500b8af4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:16.621544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 84/160] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:16.627863 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df28be-ecc8-4850-a7e4-10828db29d70 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.628155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df28be-ecc8-4850-a7e4-10828db29d70 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.628437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df28be-ecc8-4850-a7e4-10828db29d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.668748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-64df28be-ecc8-4850-a7e4-10828db29d70 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:16.670421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64df28be-ecc8-4850-a7e4-10828db29d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:16.770596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:16.795041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b412b64-1382-42ef-ac13-6962500b8af4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:16.800519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 85/161] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:16.802618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723147a-ce9b-4aa6-804f-f0331b8be69a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.802910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723147a-ce9b-4aa6-804f-f0331b8be69a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.803186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723147a-ce9b-4aa6-804f-f0331b8be69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.839746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b723147a-ce9b-4aa6-804f-f0331b8be69a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:16.841088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b723147a-ce9b-4aa6-804f-f0331b8be69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:16.865321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:16.866231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:16.866519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:16.866796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] PATH_INFO: `/v3/projects/4f45b13e2f3c466895ecbec1eff6b105` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:16.868004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] RBAC: Authorizing `identity:get_project(project_id=4f45b13e2f3c466895ecbec1eff6b105)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:16.869818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:16.874661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 77/162] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:16 2022] GET /identity/v3/projects/4f45b13e2f3c466895ecbec1eff6b105 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:16.877556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.001703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959415f7-91eb-41d9-b9b6-b84cfe5eaef9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:17.023624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 86/163] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:17.024483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723147a-ce9b-4aa6-804f-f0331b8be69a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.027422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:17.066850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:17.067553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:17.067842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:17.068119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:17.068884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:17.069192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:17.070625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:17.085325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 78/164] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:17.085952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.125452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:17.223270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723147a-ce9b-4aa6-804f-f0331b8be69a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:17.228860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0104-32fc-4ff2-9ca8-d7b55609cffe None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:17.265077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:17.266152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:17.266637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:17.267108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:17.268152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=4f45b13e2f3c466895ecbec1eff6b105, user.id=5d97e373a7e641b583ccdd262a905729) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:17.268660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:17.270355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:17.276850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 79/165] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/role_assignments?user.id=5d97e373a7e641b583ccdd262a905729&scope.project.id=4f45b13e2f3c466895ecbec1eff6b105&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:17.278420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.302551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:17.303454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:17.303753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:17.304038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:17.335080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:17.351421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:17.352559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:17.353527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:17.357004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 87/166] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:17.358024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.403704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:17.449660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda7114-2e60-4c6b-af4f-d6a00a3d6bed None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:17.500167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:17.537456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:17.538582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:17.539008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:17.539604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:17.593728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:17.597520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2e2fd-3698-4f93-82a7-06b21c00a9ca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:17.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:17.611257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:17.612242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:17.614761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 80/167] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:17.615754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.643726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:17.644912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:17.645446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:17.645823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] PATH_INFO: `/v3/users/5d97e373a7e641b583ccdd262a905729` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:17.647353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] RBAC: Authorizing `identity:get_user(user_id=5d97e373a7e641b583ccdd262a905729)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:17.649235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:17.651368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 88/168] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/users/5d97e373a7e641b583ccdd262a905729 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:17.652351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.791889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf107e6d-62a6-42c6-821d-7be2357ff881 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:17.830986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56921d2c-b431-410e-8202-6aaa2b9d61bc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:17.856638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:17.857623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:17.858050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:17.858528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:17.859431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:17.859884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:17.861429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:17.878810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 81/169] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:17.880721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:17.892809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:17.894589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:17.907236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:17.907937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:17.908282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:17.908561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:17.909336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:17.909643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:17.911088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:17.927401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 89/170] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:17.928297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:18.051222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1ddc6-aae9-48f9-81b7-932a806e5a25 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:18.109133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:18.110029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.110340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.110622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] PATH_INFO: `/v3/users/cdb4b9b6d3454623bc4e3da9f57229bb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.113761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] RBAC: Authorizing `identity:get_user(user_id=cdb4b9b6d3454623bc4e3da9f57229bb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:18.115271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:18.116936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 90/171] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/users/cdb4b9b6d3454623bc4e3da9f57229bb => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:18.117704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:18.126796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b803a57-c4ea-4010-9d86-d2951468cdc0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:18.192673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:18.193396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.193691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.193967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.230502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:18.315837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:18.318564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:18.329304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3c9a-bca0-4dbd-b0f8-124c5886dcc8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:18.344489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:18.406858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:18.408152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.408634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.409107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] PATH_INFO: `/v3/users/0996f80baf904a69852b0b6c8fb6bc6f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.410656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] RBAC: Authorizing `identity:get_user(user_id=0996f80baf904a69852b0b6c8fb6bc6f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:18.412364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:18.414232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 91/172] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:18 2022] GET /identity/v3/users/0996f80baf904a69852b0b6c8fb6bc6f => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:18.415206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:18.500876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 82/173] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:18.501904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:18.567985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ffa62-ca56-4ece-8f52-eef1d9b0d55f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:18.596847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:18.608112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7b7f9-5741-44ba-a1e4-6a519ee26849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:18.609414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7b7f9-5741-44ba-a1e4-6a519ee26849 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.609897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7b7f9-5741-44ba-a1e4-6a519ee26849 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.610438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7b7f9-5741-44ba-a1e4-6a519ee26849 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.611881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7b7f9-5741-44ba-a1e4-6a519ee26849 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:18.613638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7b7f9-5741-44ba-a1e4-6a519ee26849 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:18.615849 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 92/174] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:18 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:18.617334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ca7c0-2fc5-497c-a3c5-5ada4c814804 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.617840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ca7c0-2fc5-497c-a3c5-5ada4c814804 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.618347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ca7c0-2fc5-497c-a3c5-5ada4c814804 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.620220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 93/175] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:18.621279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ca7c0-2fc5-497c-a3c5-5ada4c814804 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:18.632141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6157208-bc49-44b9-99b3-3675f6819ffa None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:18.634748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:18.668091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:18.668869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.669154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.669480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.741832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ca7c0-2fc5-497c-a3c5-5ada4c814804 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:18.744164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:18.745921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:18.780764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1543-7916-4336-ae21-af2ff08455b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:18.782045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1543-7916-4336-ae21-af2ff08455b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.782566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1543-7916-4336-ae21-af2ff08455b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.783034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1543-7916-4336-ae21-af2ff08455b8 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.784436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1543-7916-4336-ae21-af2ff08455b8 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:18.786276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1543-7916-4336-ae21-af2ff08455b8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:18.788333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 94/176] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:18 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:18.789688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398fda-31e6-40cd-a67f-a19b4a2e81e0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.790197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398fda-31e6-40cd-a67f-a19b4a2e81e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.790672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398fda-31e6-40cd-a67f-a19b4a2e81e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:18.809391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1e398fda-31e6-40cd-a67f-a19b4a2e81e0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:18.811148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1e398fda-31e6-40cd-a67f-a19b4a2e81e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:18.856756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 83/177] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:18.857386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:18.861205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:18.883245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:18.893893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 95/178] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:18.895192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398fda-31e6-40cd-a67f-a19b4a2e81e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:18.961049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db2c54-47ee-48e1-84a7-67590bd5d1b0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:18.996394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:18.997291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:18.997572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:18.997843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/cdb4b9b6d3454623bc4e3da9f57229bb/roles/3df06c8b10b2453cb3c7bfa7139b4e20` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.000042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbf23601e34aa3b5f779f7742e321c, user_id=cdb4b9b6d3454623bc4e3da9f57229bb, role_id=3df06c8b10b2453cb3c7bfa7139b4e20)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:19.000854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398fda-31e6-40cd-a67f-a19b4a2e81e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.001524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:19.019527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 84/179] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:18 2022] PUT /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/users/cdb4b9b6d3454623bc4e3da9f57229bb/roles/3df06c8b10b2453cb3c7bfa7139b4e20 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:19.020557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.042816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.043886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.044372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.044954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.046063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] RBAC: Adding query filter params (role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=5d97e373a7e641b583ccdd262a905729) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:19.046673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:19.048524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:19.056314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 96/180] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:18 2022] GET /identity/v3/role_assignments?user.id=5d97e373a7e641b583ccdd262a905729&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=66551becb6cc4504bfbd74555d898a06 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:19.057526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.119238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:19.150910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:19.211154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753868-3ab3-48d3-b7bb-de01e849d33a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.231278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed35f4-9030-4a51-a80f-dabfb3e0cba3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.258209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447341-4a30-448f-87ec-ff8a84a5e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.260418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447341-4a30-448f-87ec-ff8a84a5e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.261082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447341-4a30-448f-87ec-ff8a84a5e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.261822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447341-4a30-448f-87ec-ff8a84a5e1a9 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.263999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19447341-4a30-448f-87ec-ff8a84a5e1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:19.266673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19447341-4a30-448f-87ec-ff8a84a5e1a9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:19.269942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 85/181] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:19.272699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10923-edb4-4dab-b37b-bb47ff307d05 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.273460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10923-edb4-4dab-b37b-bb47ff307d05 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.274038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10923-edb4-4dab-b37b-bb47ff307d05 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.276326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 86/182] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:19.279413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22df57-2150-4211-a5da-435454e5702f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.279705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22df57-2150-4211-a5da-435454e5702f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.279980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22df57-2150-4211-a5da-435454e5702f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.281960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 87/183] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:19.286423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22df57-2150-4211-a5da-435454e5702f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.287243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4c249-7b3e-428b-b751-8c7aa5eb57bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.287995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c249-7b3e-428b-b751-8c7aa5eb57bc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.288274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c249-7b3e-428b-b751-8c7aa5eb57bc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c249-7b3e-428b-b751-8c7aa5eb57bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.304784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4c249-7b3e-428b-b751-8c7aa5eb57bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8fd4c249-7b3e-428b-b751-8c7aa5eb57bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:19.314490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:19.315466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:19.316268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 97/184] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:19.316913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61519-0901-4476-9c76-4adc73b1db5b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.316913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61519-0901-4476-9c76-4adc73b1db5b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.317037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61519-0901-4476-9c76-4adc73b1db5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.335222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-05c61519-0901-4476-9c76-4adc73b1db5b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:19.336457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-05c61519-0901-4476-9c76-4adc73b1db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:19.429214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22df57-2150-4211-a5da-435454e5702f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.434523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 98/185] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:19.436024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74c21-5870-4fb9-bf9d-eb7a2711b4ec None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.436319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74c21-5870-4fb9-bf9d-eb7a2711b4ec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.436598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74c21-5870-4fb9-bf9d-eb7a2711b4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.456210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f5d74c21-5870-4fb9-bf9d-eb7a2711b4ec None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:19.457448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f5d74c21-5870-4fb9-bf9d-eb7a2711b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:19.465740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:19.472577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.473236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.473512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.473783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.474652 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=0996f80baf904a69852b0b6c8fb6bc6f) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:19.474966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:19.476428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:19.482762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 88/186] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/role_assignments?user.id=0996f80baf904a69852b0b6c8fb6bc6f&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:19.483367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.516164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:19.557691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 99/187] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:19.558962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74c21-5870-4fb9-bf9d-eb7a2711b4ec None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.602986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c6060-ca47-4660-818a-216476eea611 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.641003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.641994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.642449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.642863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.643772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:19.644229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:19.645813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:19.655676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 89/188] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:19.656829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.703341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74c21-5870-4fb9-bf9d-eb7a2711b4ec None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.727921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:19.755195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.756007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.756289 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.756558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.757712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:19.761604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:19.763006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 100/189] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:19.763668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.782005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291028f-2690-4c98-8676-699a158faac2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.823390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.824461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:19.824574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.824792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.825069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.835968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:19.844231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:19.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:19.846030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 90/190] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:19.847406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.887056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8fda8-6f3f-4f71-8abc-fdec7faa39cb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.922292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:19.923181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:19.923463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:19.923735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] PATH_INFO: `/v3/users/04997594910144ff91be649d519acf54` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:19.939069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=04997594910144ff91be649d519acf54)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:19.940557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:19.942442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 101/191] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/users/04997594910144ff91be649d519acf54 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:19.943033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:19.965889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc033-2453-4fec-b8a3-bae5f0653d47 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:19.985199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:20.004022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.004648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.004919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.005197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:20.006156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:20.007429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:20.034392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 91/192] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:19 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:20.035221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:20.055359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b78691-ab09-45cc-a97a-4f15a4cc7fd8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:20.060150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:20.104595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.105703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.105991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.106341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:20.107195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:20.107794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:20.109860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:20.126275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 102/193] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:20.132115 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:20.180715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81079e-e3fd-4649-bef3-3427d9df791a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:20.226664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.227929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.229194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.229670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:20.263684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54866291-da35-48ad-9483-4f486aeab051 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:20.287141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:20.311090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.313129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.313413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.313733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] PATH_INFO: `/v3/users/04997594910144ff91be649d519acf54` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:20.315942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] RBAC: Authorizing `identity:get_user(user_id=04997594910144ff91be649d519acf54)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:20.317597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:20.319725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 103/194] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:20 2022] GET /identity/v3/users/04997594910144ff91be649d519acf54 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:20.325045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:20.326690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:20.327341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:20.375079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:20.451740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 92/195] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:20.458539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:20.460001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f3e61-7303-47a4-842c-19f1451eaf1a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:20.501009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.501585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.501865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.502160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:20.570427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:20.592924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:20.594471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:20.604795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d199bb-fbc0-4a8f-a01e-947ed9e69b80 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:20.628773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:20.650825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.651878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.652204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.652483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:20.654291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:20.655775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:20.657552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 93/196] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:20 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:20.663509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:20.777428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54acaf-3916-4f5d-83c6-6250548968bd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:20.781014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 104/197] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:20.786648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:20.825921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.826626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.826912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.827196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:20.828150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=04997594910144ff91be649d519acf54) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:20.828571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:20.830065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:20.840654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 94/198] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:20 2022] GET /identity/v3/role_assignments?user.id=04997594910144ff91be649d519acf54&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:20.937305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8480-7369-4dbd-bcdc-39e3e4852de5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:20.996511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333b921-1615-4a1d-957f-9ec1f33614f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:20.997412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b921-1615-4a1d-957f-9ec1f33614f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:20.997704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b921-1615-4a1d-957f-9ec1f33614f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:20.997978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b921-1615-4a1d-957f-9ec1f33614f7 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:21.003112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333b921-1615-4a1d-957f-9ec1f33614f7 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:21.004639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333b921-1615-4a1d-957f-9ec1f33614f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:21.006693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 105/199] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:20 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:21.015333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:21.027800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:21.171799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aaf9b-e42b-40de-af95-b532621cc61f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:21.207777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91915ea-61d0-4faf-9ea5-2732cea3dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:21.208447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91915ea-61d0-4faf-9ea5-2732cea3dd99 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:21.208730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91915ea-61d0-4faf-9ea5-2732cea3dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:21.209007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91915ea-61d0-4faf-9ea5-2732cea3dd99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:21.209906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91915ea-61d0-4faf-9ea5-2732cea3dd99 None admin] RBAC: Adding query filter params (role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=04997594910144ff91be649d519acf54) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:21.210255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91915ea-61d0-4faf-9ea5-2732cea3dd99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:21.211789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91915ea-61d0-4faf-9ea5-2732cea3dd99 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:21.218070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 95/200] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:21 2022] GET /identity/v3/role_assignments?user.id=04997594910144ff91be649d519acf54&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=66551becb6cc4504bfbd74555d898a06 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:21.688103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3f6b-67a2-4555-b7c8-3f4b18ba6214 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:21.688483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3f6b-67a2-4555-b7c8-3f4b18ba6214 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:21.688661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3f6b-67a2-4555-b7c8-3f4b18ba6214 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:21.690295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 106/201] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:21.695805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072043-5bd6-438d-b47e-7975901a15b0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:21.696252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072043-5bd6-438d-b47e-7975901a15b0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:21.696430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072043-5bd6-438d-b47e-7975901a15b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:21.722143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5e072043-5bd6-438d-b47e-7975901a15b0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:21.723363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5e072043-5bd6-438d-b47e-7975901a15b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:21.803808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:21.811724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 96/202] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:21.847278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3f6b-67a2-4555-b7c8-3f4b18ba6214 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:21.850369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:21.993948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3f6b-67a2-4555-b7c8-3f4b18ba6214 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:22.043279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:22.044105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:22.044392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:22.044670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:22.065129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:22.072764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:22.073773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:22.074605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:22.075919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 107/203] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:22.080651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072043-5bd6-438d-b47e-7975901a15b0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:22.228041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072043-5bd6-438d-b47e-7975901a15b0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:22.277246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:22.278088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:22.278400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:22.278685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:22.279449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:22.279762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:22.281166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:22.290085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 97/204] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:22.299253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:22.436559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:22.495674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a3df-fea8-40e0-953f-39ad08260132 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:22.554993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63309b10-8a73-4e87-9dc6-1cccacfbc6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:22.555902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63309b10-8a73-4e87-9dc6-1cccacfbc6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:22.556186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63309b10-8a73-4e87-9dc6-1cccacfbc6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:22.556467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63309b10-8a73-4e87-9dc6-1cccacfbc6c8 None admin] PATH_INFO: `/v3/users/cdb4b9b6d3454623bc4e3da9f57229bb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:22.557672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63309b10-8a73-4e87-9dc6-1cccacfbc6c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cdb4b9b6d3454623bc4e3da9f57229bb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:22.559216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63309b10-8a73-4e87-9dc6-1cccacfbc6c8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:22.561195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 108/205] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:22 2022] GET /identity/v3/users/cdb4b9b6d3454623bc4e3da9f57229bb => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:22.566482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:22.654167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:22.680966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd67f-25ee-430c-801d-e878c0778140 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:22.715973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:22.716730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:22.716921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:22.717201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:22.808092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:22.810314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:22.890618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:22.911294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd480c-2277-4258-81b5-7f199154e89d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:22.911814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd480c-2277-4258-81b5-7f199154e89d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:22.911922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd480c-2277-4258-81b5-7f199154e89d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:22.913222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 109/206] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:22.923922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89d8c-60d8-438c-ba10-4582f84d09a9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:22.924209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89d8c-60d8-438c-ba10-4582f84d09a9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:22.924491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89d8c-60d8-438c-ba10-4582f84d09a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:22.942239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 98/207] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:22.946741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:22.966457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-96a89d8c-60d8-438c-ba10-4582f84d09a9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:22.967984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-96a89d8c-60d8-438c-ba10-4582f84d09a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:23.102858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 110/208] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:23.108332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576dda5-83c7-4eeb-b064-f7734437c1d6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:23.145598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89d8c-60d8-438c-ba10-4582f84d09a9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:23.159608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:23.161705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.163542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.164024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.166336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:23.168507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:23.171592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 99/209] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:22 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:23.177414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:23.219976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:23.227405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:23.272450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89d8c-60d8-438c-ba10-4582f84d09a9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:23.305116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af18698-77da-42e4-a8ab-fd99fec3cc61 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:23.309770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8452a-dfd7-4d15-a23f-20fbeb98244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:23.310813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8452a-dfd7-4d15-a23f-20fbeb98244f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.311245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8452a-dfd7-4d15-a23f-20fbeb98244f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.311699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8452a-dfd7-4d15-a23f-20fbeb98244f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.323360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8452a-dfd7-4d15-a23f-20fbeb98244f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-32a8452a-dfd7-4d15-a23f-20fbeb98244f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:23.332146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:23.333261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:23.334075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:23.336723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 111/210] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:23.338191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46462e3-c52c-43fe-9ec9-6176e16458df None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.338751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46462e3-c52c-43fe-9ec9-6176e16458df None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.339281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46462e3-c52c-43fe-9ec9-6176e16458df None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.342948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 112/211] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:23.344028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46462e3-c52c-43fe-9ec9-6176e16458df None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:23.356761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67661-5146-4919-9ff1-b65c25f99484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:23.357778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67661-5146-4919-9ff1-b65c25f99484 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.358715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67661-5146-4919-9ff1-b65c25f99484 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.359178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67661-5146-4919-9ff1-b65c25f99484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.360623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67661-5146-4919-9ff1-b65c25f99484 None admin] RBAC: Adding query filter params (role.id=3df06c8b10b2453cb3c7bfa7139b4e20, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c, user.id=cdb4b9b6d3454623bc4e3da9f57229bb) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:23.361394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67661-5146-4919-9ff1-b65c25f99484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:23.363372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67661-5146-4919-9ff1-b65c25f99484 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:23.372966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 100/212] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:23 2022] GET /identity/v3/role_assignments?user.id=cdb4b9b6d3454623bc4e3da9f57229bb&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=3df06c8b10b2453cb3c7bfa7139b4e20 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:23.374568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6a250-ad3a-42c2-abc0-f4f1f1529eb4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.375021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6a250-ad3a-42c2-abc0-f4f1f1529eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.375459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6a250-ad3a-42c2-abc0-f4f1f1529eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.398627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a0a6a250-ad3a-42c2-abc0-f4f1f1529eb4 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:23.400470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a0a6a250-ad3a-42c2-abc0-f4f1f1529eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:23.500963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 101/213] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:23.529531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46462e3-c52c-43fe-9ec9-6176e16458df None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:23.556076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6a250-ad3a-42c2-abc0-f4f1f1529eb4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:23.576085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:23.596694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:23.597777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.598310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.598826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.599783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:23.600289 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:23.601919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:23.607013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:23.614128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 113/214] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:23.626257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:23.752580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6a250-ad3a-42c2-abc0-f4f1f1529eb4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:23.762144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92154-2d0a-4fec-ae3f-abb0d2f758ca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:23.794067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935116a-a865-4009-b5ca-70cc88f2658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:23.795023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935116a-a865-4009-b5ca-70cc88f2658d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.795542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935116a-a865-4009-b5ca-70cc88f2658d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.795645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935116a-a865-4009-b5ca-70cc88f2658d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.798424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935116a-a865-4009-b5ca-70cc88f2658d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:23.800209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935116a-a865-4009-b5ca-70cc88f2658d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:23.803092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 102/215] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:23.805442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda908-27ef-4912-b147-1875922a9138 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.805442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda908-27ef-4912-b147-1875922a9138 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.805442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda908-27ef-4912-b147-1875922a9138 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.805442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 103/216] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:23.808314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bda908-27ef-4912-b147-1875922a9138 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:23.819948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba324d-c23a-44a6-8464-ee5a211690e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:23.821650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba324d-c23a-44a6-8464-ee5a211690e7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.822583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba324d-c23a-44a6-8464-ee5a211690e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.822873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba324d-c23a-44a6-8464-ee5a211690e7 None admin] PATH_INFO: `/v3/users/3a8d1d96d90e460d8c4136223eda80a4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.839436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba324d-c23a-44a6-8464-ee5a211690e7 None admin] RBAC: Authorizing `identity:get_user(user_id=3a8d1d96d90e460d8c4136223eda80a4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:23.841081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba324d-c23a-44a6-8464-ee5a211690e7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:23.848864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 114/217] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:23 2022] GET /identity/v3/users/3a8d1d96d90e460d8c4136223eda80a4 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:23.848864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42574-d752-4de1-8656-9f1bd68229ea None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.848864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42574-d752-4de1-8656-9f1bd68229ea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.848864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42574-d752-4de1-8656-9f1bd68229ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.866451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-73b42574-d752-4de1-8656-9f1bd68229ea None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:23.867760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-73b42574-d752-4de1-8656-9f1bd68229ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:23.903687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:23.915928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:23.926411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bda908-27ef-4912-b147-1875922a9138 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:23.940512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 115/218] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:23.951647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b42574-d752-4de1-8656-9f1bd68229ea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:23.961043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:23.962211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:23.962502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:23.963141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:23.963500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:23.965120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:23.985473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 104/219] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:23 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:23.985473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.074483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b42574-d752-4de1-8656-9f1bd68229ea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.113556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc74ced-e775-4f02-a0bd-15d3ffce7e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.114274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc74ced-e775-4f02-a0bd-15d3ffce7e86 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.114608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc74ced-e775-4f02-a0bd-15d3ffce7e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.114888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc74ced-e775-4f02-a0bd-15d3ffce7e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.129378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd390f5-0b62-42ac-91e0-072c1489dc64 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.161426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:24.171047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41a66-f6e7-4712-960e-e64963f790d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.172188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41a66-f6e7-4712-960e-e64963f790d7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.172771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41a66-f6e7-4712-960e-e64963f790d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.173132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41a66-f6e7-4712-960e-e64963f790d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.185534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41a66-f6e7-4712-960e-e64963f790d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:24.193926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc74ced-e775-4f02-a0bd-15d3ffce7e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-bba41a66-f6e7-4712-960e-e64963f790d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:24.194605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:24.195526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:24.196336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:24.196946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc74ced-e775-4f02-a0bd-15d3ffce7e86 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:24.198622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 105/220] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:24.200138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518fd1-6443-4dc1-852e-030b2b591249 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.200573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518fd1-6443-4dc1-852e-030b2b591249 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.200990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518fd1-6443-4dc1-852e-030b2b591249 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.202449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 106/221] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:24.204449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518fd1-6443-4dc1-852e-030b2b591249 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.217197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:24.325654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 116/222] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:24.328691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b8a3a-ed53-4710-bfbe-7efd5ffff4e3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.329156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b8a3a-ed53-4710-bfbe-7efd5ffff4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.329572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b8a3a-ed53-4710-bfbe-7efd5ffff4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.338663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518fd1-6443-4dc1-852e-030b2b591249 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.349467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5c8b8a3a-ed53-4710-bfbe-7efd5ffff4e3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:24.350773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c8b8a3a-ed53-4710-bfbe-7efd5ffff4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:24.380474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.381161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.381442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.381717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.382508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:24.382822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:24.384212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:24.397268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 107/223] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:24.398537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.429403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:24.442742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 117/224] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:24.443657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b8a3a-ed53-4710-bfbe-7efd5ffff4e3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.479167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:24.521700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94069a-f23d-4a42-8679-642f973eeab3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.571492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b8a3a-ed53-4710-bfbe-7efd5ffff4e3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.571679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.572525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.572808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.573082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.575324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:24.577825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:24.579735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 108/225] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:24 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:24.584966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.623627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.624522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.624805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.625081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] PATH_INFO: `/v3/users/04997594910144ff91be649d519acf54` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.626477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] RBAC: Authorizing `identity:get_user(user_id=04997594910144ff91be649d519acf54)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:24.628865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:24.630570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 118/226] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:24 2022] GET /identity/v3/users/04997594910144ff91be649d519acf54 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:24.635293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.704007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde34cb-3551-4f1b-9745-3ae543c53798 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.723493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:24.744787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.745707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.745994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.746303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.754321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:24.758644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:24.768219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:24.769109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:24.769887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 109/227] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:24.770566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.772521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217605b2-7d26-4ea4-9d39-560aa41aa219 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.809898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.811106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.811945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.812706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.813903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=3a8d1d96d90e460d8c4136223eda80a4) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:24.814732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:24.816678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:24.824286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 119/228] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:24 2022] GET /identity/v3/role_assignments?user.id=3a8d1d96d90e460d8c4136223eda80a4&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:24.825419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.894892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a4a5-ff56-43dd-9c75-af31df221419 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:24.946449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:24.947359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:24.947637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:24.947917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:24.952758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:24.957433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:24.959590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 110/229] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:24 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:24.969827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:24.981905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272630-9ee1-4c10-ae54-1e171d05887b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:25.017963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:25.033338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:25.034030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:25.034343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:25.034621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:25.035383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:25.035693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:25.037120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:25.052598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 120/230] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:25.066136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:25.137697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:25.180728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ce85-5492-49f0-95e5-c30ec3205807 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:25.215614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0e8a-c2b4-4a35-9667-162408248602 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:25.226976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:25.227723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:25.228010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:25.228293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/04997594910144ff91be649d519acf54/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:25.235466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e033f2a03224efcbefc45d2fd80e48d, user_id=04997594910144ff91be649d519acf54, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:25.237022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:25.254029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:25.255316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:25.255828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:25.256331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] PATH_INFO: `/v3/users/04997594910144ff91be649d519acf54` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:25.257795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] RBAC: Authorizing `identity:get_user(user_id=04997594910144ff91be649d519acf54)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:25.259569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:25.261685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 121/231] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:25 2022] GET /identity/v3/users/04997594910144ff91be649d519acf54 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:25.266159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 111/232] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:24 2022] PUT /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/04997594910144ff91be649d519acf54/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:25.267585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:25.345173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:25.387772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117da629-3e86-4b60-9ef3-0105fdabc7dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:25.425907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25db932-7b79-4ac8-ad18-780b7339b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:25.426834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25db932-7b79-4ac8-ad18-780b7339b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:25.427113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25db932-7b79-4ac8-ad18-780b7339b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:25.427386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25db932-7b79-4ac8-ad18-780b7339b4f4 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:25.428719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25db932-7b79-4ac8-ad18-780b7339b4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:25.430277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25db932-7b79-4ac8-ad18-780b7339b4f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:25.432388 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 122/233] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:25 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:25.438453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:25.580974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011b4b-f3d0-4fd4-ba14-b3a171666851 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:25.617454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:25.628717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453111-8271-464f-a2dc-c4de8f5db1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:25.629635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453111-8271-464f-a2dc-c4de8f5db1e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:25.629922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453111-8271-464f-a2dc-c4de8f5db1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:25.630257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453111-8271-464f-a2dc-c4de8f5db1e3 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/04997594910144ff91be649d519acf54/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:25.632601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc453111-8271-464f-a2dc-c4de8f5db1e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e033f2a03224efcbefc45d2fd80e48d, user_id=04997594910144ff91be649d519acf54, role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:25.634541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc453111-8271-464f-a2dc-c4de8f5db1e3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:25.654344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 112/234] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:25 2022] PUT /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/04997594910144ff91be649d519acf54/roles/66551becb6cc4504bfbd74555d898a06 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:26.705327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adcef8-c224-4fca-a72a-eb80c6337fb3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:26.705876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adcef8-c224-4fca-a72a-eb80c6337fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:26.705876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adcef8-c224-4fca-a72a-eb80c6337fb3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:26.707557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 123/235] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:26.712907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ef50-a35d-47ad-b120-550f07e89e0e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:26.713296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ef50-a35d-47ad-b120-550f07e89e0e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:26.713493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ef50-a35d-47ad-b120-550f07e89e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:26.739267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4444ef50-a35d-47ad-b120-550f07e89e0e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:26.740491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4444ef50-a35d-47ad-b120-550f07e89e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:26.845507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 113/236] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:26.877252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e92c-e75d-40b4-b56c-e5a0f2bcd02e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:26.877887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e92c-e75d-40b4-b56c-e5a0f2bcd02e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:26.878405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e92c-e75d-40b4-b56c-e5a0f2bcd02e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:26.880258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 124/237] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:26.885562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d018c-5422-46e7-877a-58dc2e3f7c97 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:26.885859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d018c-5422-46e7-877a-58dc2e3f7c97 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:26.886250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d018c-5422-46e7-877a-58dc2e3f7c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:26.887093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e92c-e75d-40b4-b56c-e5a0f2bcd02e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:26.905301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-394d018c-5422-46e7-877a-58dc2e3f7c97 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:26.906577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-394d018c-5422-46e7-877a-58dc2e3f7c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:26.991553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 114/238] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:27.032953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d018c-5422-46e7-877a-58dc2e3f7c97 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:27.084069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e92c-e75d-40b4-b56c-e5a0f2bcd02e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:27.123127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:27.147860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:27.158584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:27.159403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.159688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.159966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.186442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:27.202315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:27.203278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 125/239] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:27.204076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:27.235289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d018c-5422-46e7-877a-58dc2e3f7c97 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:27.306651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38159d-4386-4f40-a35d-b91cbc828543 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:27.320510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:27.321339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.321618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.321890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.326851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:27.328368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:27.330395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 115/240] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:27.335691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:27.349066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:27.349801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.350090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.350414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.351267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:27.351581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:27.352982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:27.362388 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 126/241] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:27.368023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:27.435098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:27.474416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e199-8fb7-4b01-8735-eceebaf72a90 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:27.518146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:27.518146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.518146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.518146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] PATH_INFO: `/v3/users/8371789307454fa990f01f45caf0f9a1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.534288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=8371789307454fa990f01f45caf0f9a1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:27.534288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:27.534666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 127/242] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:27 2022] GET /identity/v3/users/8371789307454fa990f01f45caf0f9a1 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:27.540388 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:27.567980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca3881-16dd-4064-8c1e-2894222dbaea None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:27.595582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:27.649069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4021f0-5928-4af8-8883-113f8c069cd9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:27.662480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:27.663429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:27.664137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.664511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.664791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.665525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:27.667244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:27.689207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a2990-04ca-4133-88a5-d5b0045a100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:27.690144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a2990-04ca-4133-88a5-d5b0045a100f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.690634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a2990-04ca-4133-88a5-d5b0045a100f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.691227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a2990-04ca-4133-88a5-d5b0045a100f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.719843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 116/243] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:27 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:48:27.770736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a2990-04ca-4133-88a5-d5b0045a100f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:27.772808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a2990-04ca-4133-88a5-d5b0045a100f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:27.890482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 128/244] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:27.896346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:27.918487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe568f0-351f-46ff-88e2-3ae5c7e6cb47 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.919061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe568f0-351f-46ff-88e2-3ae5c7e6cb47 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.919513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe568f0-351f-46ff-88e2-3ae5c7e6cb47 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.921160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 129/245] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:27.944375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff80d-080d-487c-8086-df8a58a760e0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:27.944953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff80d-080d-487c-8086-df8a58a760e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:27.945421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff80d-080d-487c-8086-df8a58a760e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:27.967315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cc6ff80d-080d-487c-8086-df8a58a760e0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:27.968934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cc6ff80d-080d-487c-8086-df8a58a760e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:27.973116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:28.016881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4c27-0100-4afc-b647-367458c76e11 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.046749 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 130/246] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:28.056976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:28.058319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.058976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.059510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.060967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:28.062680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:28.065189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 117/247] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:27 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:28.071362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff80d-080d-487c-8086-df8a58a760e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.073981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.122072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:28.187508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834f67-c91e-485f-a08b-1bbb79a9b440 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.192126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff80d-080d-487c-8086-df8a58a760e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.224190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd402-2a6c-432d-ac68-d8dbb1b61720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:28.224857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd402-2a6c-432d-ac68-d8dbb1b61720 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.225135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd402-2a6c-432d-ac68-d8dbb1b61720 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.225409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd402-2a6c-432d-ac68-d8dbb1b61720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.226280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bd402-2a6c-432d-ac68-d8dbb1b61720 None admin] RBAC: Adding query filter params (role.id=3df06c8b10b2453cb3c7bfa7139b4e20, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=8371789307454fa990f01f45caf0f9a1) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:28.226597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bd402-2a6c-432d-ac68-d8dbb1b61720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:28.228054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bd402-2a6c-432d-ac68-d8dbb1b61720 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:28.231254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:28.232372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.232851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.233303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.237046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 118/248] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/role_assignments?user.id=8371789307454fa990f01f45caf0f9a1&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=3df06c8b10b2453cb3c7bfa7139b4e20 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:28.243671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1d84-aea6-47a1-ad2c-6a3f656edb2c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.244183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:28.244297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1d84-aea6-47a1-ad2c-6a3f656edb2c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.244498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1d84-aea6-47a1-ad2c-6a3f656edb2c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.246369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 119/249] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:28.248394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:28.251865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4046c-ce5b-4153-8ff8-3089958d47d0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.252211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4046c-ce5b-4153-8ff8-3089958d47d0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.252426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4046c-ce5b-4153-8ff8-3089958d47d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:28.259175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:28.260533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:28.261712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:28.263583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 131/250] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:28.271295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.285226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-39c4046c-ce5b-4153-8ff8-3089958d47d0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:28.287468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-39c4046c-ce5b-4153-8ff8-3089958d47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:28.387254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 120/251] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:28.410288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9892-987f-4d96-b069-38a52d470967 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.414027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4046c-ce5b-4153-8ff8-3089958d47d0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.455505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf3884-0baa-4036-9006-cded63993e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:28.456216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf3884-0baa-4036-9006-cded63993e9b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.456503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf3884-0baa-4036-9006-cded63993e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.456783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf3884-0baa-4036-9006-cded63993e9b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.457554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf3884-0baa-4036-9006-cded63993e9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:28.457862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf3884-0baa-4036-9006-cded63993e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:28.459355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf3884-0baa-4036-9006-cded63993e9b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:28.465988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:28.471133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 132/252] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:28.472989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144071-974b-48ec-8f69-d40abe6ee976 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.473506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144071-974b-48ec-8f69-d40abe6ee976 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.473996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144071-974b-48ec-8f69-d40abe6ee976 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.478258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 133/253] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:28.479422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144071-974b-48ec-8f69-d40abe6ee976 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.554903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4046c-ce5b-4153-8ff8-3089958d47d0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.565699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:28.592855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f202d8f-b2a6-45bc-a468-4ad08a078268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:28.593860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202d8f-b2a6-45bc-a468-4ad08a078268 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.594258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202d8f-b2a6-45bc-a468-4ad08a078268 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.594655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202d8f-b2a6-45bc-a468-4ad08a078268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.608905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f202d8f-b2a6-45bc-a468-4ad08a078268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2f202d8f-b2a6-45bc-a468-4ad08a078268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:28.616658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:28.617543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:28.618351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 121/254] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:28.619885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748250-719e-4690-a6d7-e0b280e0c535 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.620087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748250-719e-4690-a6d7-e0b280e0c535 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.620369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748250-719e-4690-a6d7-e0b280e0c535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.623059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144071-974b-48ec-8f69-d40abe6ee976 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.643030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-40748250-719e-4690-a6d7-e0b280e0c535 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:28.644306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-40748250-719e-4690-a6d7-e0b280e0c535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:28.669051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:28.670877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.671341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.672027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] PATH_INFO: `/v3/users/3a8d1d96d90e460d8c4136223eda80a4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.674097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] RBAC: Authorizing `identity:get_user(user_id=3a8d1d96d90e460d8c4136223eda80a4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:28.676387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:28.679141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 134/255] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/users/3a8d1d96d90e460d8c4136223eda80a4 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:28.680087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.752848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 122/256] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:28.753585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40748250-719e-4690-a6d7-e0b280e0c535 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.817771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a1b9e-9838-46b3-866f-9606309360b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.827948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:28.852634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:28.859397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:28.860497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:28.860958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:28.862244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:28.863187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:28.863673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:28.866928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:28.877944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 135/257] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:28.879435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:28.960109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40748250-719e-4690-a6d7-e0b280e0c535 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.983870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da49f4-b56e-4cee-860f-c972fc9f1d02 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:28.999084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.000145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.000495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.000864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.002207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:29.003816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:29.005568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 123/258] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:29.006466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:29.022644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.023783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.024267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.024715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.035999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:29.044845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:29.045772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:29.046589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:29.049086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 136/259] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:29.050038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:29.104764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:29.112205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:29.124949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a096d5-02ba-4120-8681-4c9211632465 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:29.156962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716347-7a0d-40c6-b0c2-6ebd30911696 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:29.161389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.162329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.162668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.162943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] PATH_INFO: `/v3/users/04997594910144ff91be649d519acf54` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.164187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] RBAC: Authorizing `identity:get_user(user_id=04997594910144ff91be649d519acf54)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:29.165669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:29.167622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 124/260] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:29 2022] GET /identity/v3/users/04997594910144ff91be649d519acf54 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:29.168480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:29.196027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.197314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.197829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.198331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/3a8d1d96d90e460d8c4136223eda80a4/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.200667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] RBAC: Authorizing `identity:create_grant(project_id=3e033f2a03224efcbefc45d2fd80e48d, user_id=3a8d1d96d90e460d8c4136223eda80a4, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:29.202360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:29.240410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 137/261] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:29 2022] PUT /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/3a8d1d96d90e460d8c4136223eda80a4/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:29.241734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:29.286232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4a13d-c38d-4893-8a88-d25fbf454129 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:29.321346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.322053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.324395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.324688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.325485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:29.325779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:29.327549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:29.336431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 125/262] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:29.342173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:29.387203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:29.435500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c019f-933e-47fe-b7cf-da4a03c1b45d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:29.458080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:29.509258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.509927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.510235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.510516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.540766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a063c-4707-440d-a8f7-65789b3213a7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:29.604327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.605501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.605831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.606201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] PATH_INFO: `/v3/users/04997594910144ff91be649d519acf54` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.607483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] RBAC: Authorizing `identity:get_user(user_id=04997594910144ff91be649d519acf54)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:29.609023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:29.610800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 126/263] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:29 2022] GET /identity/v3/users/04997594910144ff91be649d519acf54 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:29.616483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:29.640970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:29.642509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:29.786492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 138/264] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:29.791122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:29.795367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:29.816487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:29.821083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab865d2d-9d13-4f99-bf1c-b8f29300a957 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:29.887434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:29.888112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:29.888399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:29.888679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:29.992111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6945b5-caf1-419a-b722-3e188c557d8e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:30.009903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:30.011491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:30.062348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:30.063198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:30.063483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:30.063757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:30.065445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:30.066934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:30.068878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 139/265] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:29 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:30.078534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:30.159863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:30.182376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 127/266] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:30.189244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:30.227210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:30.253534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11705bf5-c9cd-421c-b543-2b4a9f18ab14 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:30.294795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:30.295478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:30.295766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:30.296044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:30.302133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=04997594910144ff91be649d519acf54) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:30.302133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:30.302133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:30.306374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 140/267] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:30 2022] GET /identity/v3/role_assignments?user.id=04997594910144ff91be649d519acf54&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:30.358817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee70d7-6218-45ef-84a0-fcd13027cac2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:30.401647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0194b1-a2e7-4e22-9099-6f2a5ae7de18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:30.402950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0194b1-a2e7-4e22-9099-6f2a5ae7de18 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:30.403376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0194b1-a2e7-4e22-9099-6f2a5ae7de18 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:30.403818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0194b1-a2e7-4e22-9099-6f2a5ae7de18 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:30.408197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0194b1-a2e7-4e22-9099-6f2a5ae7de18 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:30.409903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0194b1-a2e7-4e22-9099-6f2a5ae7de18 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:30.411943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 128/268] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:30 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:30.419227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:30.596776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0abcc-66a4-40b5-93b1-010b28638a85 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:30.634098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ecde2-1de3-46c6-a504-ad4cd8657729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:30.634720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecde2-1de3-46c6-a504-ad4cd8657729 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:30.635000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecde2-1de3-46c6-a504-ad4cd8657729 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:30.635277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecde2-1de3-46c6-a504-ad4cd8657729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:30.636109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ecde2-1de3-46c6-a504-ad4cd8657729 None admin] RBAC: Adding query filter params (role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=04997594910144ff91be649d519acf54) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:30.636488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ecde2-1de3-46c6-a504-ad4cd8657729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:30.638714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ecde2-1de3-46c6-a504-ad4cd8657729 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:30.650240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 141/269] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:30 2022] GET /identity/v3/role_assignments?user.id=04997594910144ff91be649d519acf54&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=66551becb6cc4504bfbd74555d898a06 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:31.102429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909c4f-b7ab-4349-817d-6f4b157c53ad None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.103468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909c4f-b7ab-4349-817d-6f4b157c53ad None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.103976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909c4f-b7ab-4349-817d-6f4b157c53ad None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.105933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 129/270] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:31.111159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43066ce2-e856-4fad-b9fe-ac029f0ad664 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.112031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43066ce2-e856-4fad-b9fe-ac029f0ad664 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.112510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43066ce2-e856-4fad-b9fe-ac029f0ad664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.135008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-43066ce2-e856-4fad-b9fe-ac029f0ad664 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:31.136595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-43066ce2-e856-4fad-b9fe-ac029f0ad664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:31.138984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:31.221220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 142/271] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:31.243599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84909c4f-b7ab-4349-817d-6f4b157c53ad None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:31.313548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:31.323850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530718-634c-4e23-9bcc-c0cf51c1e1f7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.324627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530718-634c-4e23-9bcc-c0cf51c1e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.325106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530718-634c-4e23-9bcc-c0cf51c1e1f7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.326978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 143/272] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:48:31.341731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa02ba-4566-4a7b-b05c-79fcf0575d21 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.342433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa02ba-4566-4a7b-b05c-79fcf0575d21 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.342919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa02ba-4566-4a7b-b05c-79fcf0575d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.360815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c1aa02ba-4566-4a7b-b05c-79fcf0575d21 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:31.362391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1aa02ba-4566-4a7b-b05c-79fcf0575d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:31.367249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84909c4f-b7ab-4349-817d-6f4b157c53ad None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:31.406666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:31.407886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.408449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.408936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.420846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:31.429332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:31.430414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:31.431388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:31.433764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 130/273] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:31.434573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 144/274] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:31.443035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:31.459328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa02ba-4566-4a7b-b05c-79fcf0575d21 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:31.544349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:31.566436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc924c5-e067-4daa-a11f-c118cf6b1170 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:31.583996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa02ba-4566-4a7b-b05c-79fcf0575d21 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:31.588819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:31.607718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:31.608619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.609043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.609486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.610497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:31.611103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:31.612628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:31.622217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e9952-c8be-4873-9dcb-f85bd9b14741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:31.622592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 131/275] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:31.623333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e9952-c8be-4873-9dcb-f85bd9b14741 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.623621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e9952-c8be-4873-9dcb-f85bd9b14741 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.623951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e9952-c8be-4873-9dcb-f85bd9b14741 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.625128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e9952-c8be-4873-9dcb-f85bd9b14741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:31.626644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e9952-c8be-4873-9dcb-f85bd9b14741 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:31.628329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:31.633156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 145/276] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:31.634480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1027c-5958-4bf1-b074-2d8777799c5b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.634769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1027c-5958-4bf1-b074-2d8777799c5b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.635048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1027c-5958-4bf1-b074-2d8777799c5b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.636654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 146/277] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:31.637204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1027c-5958-4bf1-b074-2d8777799c5b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:31.742994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1027c-5958-4bf1-b074-2d8777799c5b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:31.745574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac304c-9d3b-455c-bc87-5c08ddd2f516 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:31.781347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:31.781552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfbd31-156f-4dab-9a95-eb26fc9691aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:31.782026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.782350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbd31-156f-4dab-9a95-eb26fc9691aa None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.782448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.782691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbd31-156f-4dab-9a95-eb26fc9691aa None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.782783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.782944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbd31-156f-4dab-9a95-eb26fc9691aa None admin] PATH_INFO: `/v3/users/8371789307454fa990f01f45caf0f9a1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.783406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:31.784151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbd31-156f-4dab-9a95-eb26fc9691aa None admin] RBAC: Authorizing `identity:get_user(user_id=8371789307454fa990f01f45caf0f9a1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:31.784966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:31.785616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbd31-156f-4dab-9a95-eb26fc9691aa None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:31.787443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 132/278] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:31 2022] GET /identity/v3/users/8371789307454fa990f01f45caf0f9a1 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:31.788421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a7e11-4190-49e3-a65e-f8208fe02834 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:31.788706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a7e11-4190-49e3-a65e-f8208fe02834 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:31.788986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a7e11-4190-49e3-a65e-f8208fe02834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:31.801965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:31.810311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-719a7e11-4190-49e3-a65e-f8208fe02834 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:31.811522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-719a7e11-4190-49e3-a65e-f8208fe02834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:31.827369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 147/279] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:31 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:31.828754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:31.870068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:31.901162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 133/280] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:31.925708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a7e11-4190-49e3-a65e-f8208fe02834 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:31.964416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bd98-3cfd-4daf-93bf-09404ae3eb14 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:32.003777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:32.005194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.005796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.006337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.008239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:32.010382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:32.012759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 148/281] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:31 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:32.019235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:32.060217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a7e11-4190-49e3-a65e-f8208fe02834 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:32.095390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:32.105502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:32.106356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.106633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.107066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.124464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:32.132925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:32.133905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:32.134724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:32.138268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 134/282] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:32.144932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:32.151358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c588d-0e19-4ff9-94c7-096788eb3dd0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:32.200068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:32.200975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.201454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.201871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/8371789307454fa990f01f45caf0f9a1/roles/3df06c8b10b2453cb3c7bfa7139b4e20` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.204338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] RBAC: Authorizing `identity:create_grant(project_id=3e033f2a03224efcbefc45d2fd80e48d, user_id=8371789307454fa990f01f45caf0f9a1, role_id=3df06c8b10b2453cb3c7bfa7139b4e20)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:32.206191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:32.208199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:32.229278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 149/283] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:48:32 2022] PUT /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/users/8371789307454fa990f01f45caf0f9a1/roles/3df06c8b10b2453cb3c7bfa7139b4e20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:48:32.303171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b412ba-5dee-4560-bfe1-cde4e24caa11 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:32.342041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc1009-760d-4342-8159-a66ea3f04072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:32.342823 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc1009-760d-4342-8159-a66ea3f04072 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.343109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc1009-760d-4342-8159-a66ea3f04072 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.343419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc1009-760d-4342-8159-a66ea3f04072 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.344206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc1009-760d-4342-8159-a66ea3f04072 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:32.344515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc1009-760d-4342-8159-a66ea3f04072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:32.346036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc1009-760d-4342-8159-a66ea3f04072 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:32.356406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 135/284] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:32.362087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:32.486405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac7d5-3b5c-4e1b-80e2-87e1d8b0c2fb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:32.508783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:32.525243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:32.526158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.526454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.526740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] PATH_INFO: `/v3/users/fe40516f84fd4b1fabefb4710a3ad21f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.530871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e09c-6ce7-4a1d-8e59-e6a0a5b16396 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.532744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e09c-6ce7-4a1d-8e59-e6a0a5b16396 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.532744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e09c-6ce7-4a1d-8e59-e6a0a5b16396 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.533469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 136/285] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:32.545771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] RBAC: Authorizing `identity:get_user(user_id=fe40516f84fd4b1fabefb4710a3ad21f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:32.546680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769f7b-ee7c-4065-b3b0-810ade9a86fd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.547048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769f7b-ee7c-4065-b3b0-810ade9a86fd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.547311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:32.547409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769f7b-ee7c-4065-b3b0-810ade9a86fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.549225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 150/286] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:32 2022] GET /identity/v3/users/fe40516f84fd4b1fabefb4710a3ad21f => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:32.554577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:32.572046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fe769f7b-ee7c-4065-b3b0-810ade9a86fd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:32.573366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fe769f7b-ee7c-4065-b3b0-810ade9a86fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:32.670702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 137/287] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:32.692251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa49c6-eabd-48ad-9638-3d5d21777c9a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:32.736369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe769f7b-ee7c-4065-b3b0-810ade9a86fd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:32.741055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:32.741998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.742499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.742977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.744025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, user.id=fe40516f84fd4b1fabefb4710a3ad21f, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:32.744892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:32.746703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:32.757878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 151/288] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 3 12:48:32 2022] GET /identity/v3/role_assignments?user.id=fe40516f84fd4b1fabefb4710a3ad21f&scope.system=all&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:32.776821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:32.853458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe769f7b-ee7c-4065-b3b0-810ade9a86fd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:32.901386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:32.902706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:32.903202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:32.903683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:32.923969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:32.937295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:32.938289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:32.939281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:32.941758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 138/289] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:32.947834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:33.009940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:33.071838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ff6e8-74da-4794-b0a6-ca72453e1e80 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:33.107365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:33.108052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:33.108339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:33.108616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:33.109374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:33.109689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:33.111133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:33.120796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 152/290] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:33.126356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:33.265009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:33.281847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875f50c-6020-4bc4-af57-e2aa47bebd8b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:33.323902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:33.324816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:33.325094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:33.325369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] PATH_INFO: `/v3/users/3a8d1d96d90e460d8c4136223eda80a4` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:33.326600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] RBAC: Authorizing `identity:get_user(user_id=3a8d1d96d90e460d8c4136223eda80a4)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:33.328065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:33.329914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 139/291] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:33 2022] GET /identity/v3/users/3a8d1d96d90e460d8c4136223eda80a4 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:33.335213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:33.456551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a393-474f-436a-a7bd-2001a97de107 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:33.459324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:33.505495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:33.506206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:33.506496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:33.506777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:33.580121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:33.581623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:33.702743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 153/292] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:33.707972 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:33.878638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b5af4-b008-4c57-b5fb-7bb092180695 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:33.917763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e01803-3600-4a84-b561-ab7e488e3f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:33.919158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01803-3600-4a84-b561-ab7e488e3f09 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:33.919648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01803-3600-4a84-b561-ab7e488e3f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:33.920124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01803-3600-4a84-b561-ab7e488e3f09 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:33.921535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e01803-3600-4a84-b561-ab7e488e3f09 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:33.923249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e01803-3600-4a84-b561-ab7e488e3f09 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:33.925552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 140/293] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:33 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:33.935260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:33.938540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:34.072750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973cb85-6620-4d24-9ae9-9bff0f3403cb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:34.123745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270384-106f-4074-9680-b390aad69a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:34.124418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270384-106f-4074-9680-b390aad69a56 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:34.124704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270384-106f-4074-9680-b390aad69a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:34.124987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270384-106f-4074-9680-b390aad69a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:34.125823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270384-106f-4074-9680-b390aad69a56 None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=3a8d1d96d90e460d8c4136223eda80a4) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:34.126153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270384-106f-4074-9680-b390aad69a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:34.127614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270384-106f-4074-9680-b390aad69a56 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:34.139629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 154/294] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:33 2022] GET /identity/v3/role_assignments?user.id=3a8d1d96d90e460d8c4136223eda80a4&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:34.764381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8e00-fa1e-4122-9b9b-aab07dc7a743 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:34.765237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8e00-fa1e-4122-9b9b-aab07dc7a743 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:34.765518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8e00-fa1e-4122-9b9b-aab07dc7a743 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:34.766927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 141/295] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:34.772501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7ea25-bef2-4c5f-a5aa-ec9038041617 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:34.773311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7ea25-bef2-4c5f-a5aa-ec9038041617 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:34.773789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7ea25-bef2-4c5f-a5aa-ec9038041617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:34.794858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8ea7ea25-bef2-4c5f-a5aa-ec9038041617 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:34.796389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8ea7ea25-bef2-4c5f-a5aa-ec9038041617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:34.869005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:34.877920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 155/296] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:34.903293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8e00-fa1e-4122-9b9b-aab07dc7a743 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:34.933040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:35.023047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8e00-fa1e-4122-9b9b-aab07dc7a743 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.058840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebae55a-a2bd-46d9-9f13-f718c2261ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.059625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae55a-a2bd-46d9-9f13-f718c2261ead None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.059903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae55a-a2bd-46d9-9f13-f718c2261ead None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.060172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae55a-a2bd-46d9-9f13-f718c2261ead None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.061436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebae55a-a2bd-46d9-9f13-f718c2261ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:35.062962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebae55a-a2bd-46d9-9f13-f718c2261ead None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:35.065025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 142/297] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:35.070639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7ea25-bef2-4c5f-a5aa-ec9038041617 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.110928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9ad9-81c1-459d-8917-87206ef2abf2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.111604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9ad9-81c1-459d-8917-87206ef2abf2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.112084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9ad9-81c1-459d-8917-87206ef2abf2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.113919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 143/298] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:35.119575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8f841-b53d-4c12-936a-b600a21eb0cc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.120105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8f841-b53d-4c12-936a-b600a21eb0cc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.120618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8f841-b53d-4c12-936a-b600a21eb0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.137831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9ec8f841-b53d-4c12-936a-b600a21eb0cc None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:35.139381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9ec8f841-b53d-4c12-936a-b600a21eb0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:35.190781 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7ea25-bef2-4c5f-a5aa-ec9038041617 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.211988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 144/299] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:35.215786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057443-64f7-410f-bb39-0f764f07a383 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.216345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057443-64f7-410f-bb39-0f764f07a383 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.216762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057443-64f7-410f-bb39-0f764f07a383 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.219086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 145/300] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:35.224504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4271b-f28f-485b-bc77-a1cdf583d905 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.225039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4271b-f28f-485b-bc77-a1cdf583d905 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.225535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4271b-f28f-485b-bc77-a1cdf583d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.232738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.234506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.234956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.235447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] PATH_INFO: `/v3/groups` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.236196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:35.237667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:35.244737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-62a4271b-f28f-485b-bc77-a1cdf583d905 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:35.245934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62a4271b-f28f-485b-bc77-a1cdf583d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:35.260268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 156/301] 10.222.0.58 () {60 vars in 1134 bytes} [Fri Jun 3 12:48:35 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:35.270374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:35.270458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.334750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 146/302] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:35.342452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:35.354404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4271b-f28f-485b-bc77-a1cdf583d905 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.394823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2586fc-3111-4bf4-9d59-b42b5fa01a79 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.434438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb37ea-5f6a-4b2c-9d46-14b0a36bec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.435435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb37ea-5f6a-4b2c-9d46-14b0a36bec47 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.436607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb37ea-5f6a-4b2c-9d46-14b0a36bec47 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.436893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb37ea-5f6a-4b2c-9d46-14b0a36bec47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.452400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb37ea-5f6a-4b2c-9d46-14b0a36bec47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5aeb37ea-5f6a-4b2c-9d46-14b0a36bec47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:35.462566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:35.463506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:35.465446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 157/303] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:35.466385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36157-4ff1-4e89-b6a0-06d40955716d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.467658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36157-4ff1-4e89-b6a0-06d40955716d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.467658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36157-4ff1-4e89-b6a0-06d40955716d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.472289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4271b-f28f-485b-bc77-a1cdf583d905 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.472427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 158/304] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:35.472427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36157-4ff1-4e89-b6a0-06d40955716d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.508364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412102-526a-4759-b002-e660e93912a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.509185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412102-526a-4759-b002-e660e93912a1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.509472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412102-526a-4759-b002-e660e93912a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.509983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412102-526a-4759-b002-e660e93912a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.522529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e412102-526a-4759-b002-e660e93912a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0e412102-526a-4759-b002-e660e93912a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:35.533740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:35.534722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:35.535518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 147/305] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:35.537114 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bb99-9759-43f5-967c-4efcf75bbadf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.537114 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bb99-9759-43f5-967c-4efcf75bbadf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.537283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bb99-9759-43f5-967c-4efcf75bbadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.557926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a025bb99-9759-43f5-967c-4efcf75bbadf None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:35.559301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a025bb99-9759-43f5-967c-4efcf75bbadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:35.567639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:35.592488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36157-4ff1-4e89-b6a0-06d40955716d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.613912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:35.632703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.633436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.633722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.634041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.634893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:35.635327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:35.636631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:35.639686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 148/306] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:35.642991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025bb99-9759-43f5-967c-4efcf75bbadf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.651065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 159/307] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:35.651995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.754742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb5f32-47e7-4ff0-abf6-b133f1428490 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.768091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025bb99-9759-43f5-967c-4efcf75bbadf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.791764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.792694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.793009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.793277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] PATH_INFO: `/v3/users/50218285b0074ac89ebd682dd88c2c5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.804311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.805077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.805375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.805641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.806467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:35.806776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:35.807879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] RBAC: Authorizing `identity:get_user(user_id=50218285b0074ac89ebd682dd88c2c5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:35.808177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:35.809605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:35.811369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 160/308] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/users/50218285b0074ac89ebd682dd88c2c5b => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:35.812153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.817670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 149/309] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:35.818722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.826861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:35.859739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:35.926592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3524-98e1-4be4-9d38-037c77de230c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.927261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f850e4-c15c-43cb-984c-3463f5ca9348 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:35.962645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.962841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:35.963306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.963478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:35.963573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.963738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:35.963843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.964013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:35.967704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] RBAC: Adding query filter params (role.id=3df06c8b10b2453cb3c7bfa7139b4e20, user.id=50218285b0074ac89ebd682dd88c2c5b, scope.system=all) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:35.968041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:35.969535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:35.982543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 150/310] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/role_assignments?user.id=50218285b0074ac89ebd682dd88c2c5b&scope.system=all&role.id=3df06c8b10b2453cb3c7bfa7139b4e20 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:35.982808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:35.982944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:35.984760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:35.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:35.987725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 161/311] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:35.995964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:36.074313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:36.111046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:36.117420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b885-4efc-4e35-a188-7ba0050471f2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:36.123961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b92d-d902-4132-a6ab-f884570af824 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:36.164484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:36.165005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:36.165283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:36.165560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:36.166412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:36.166702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:36.168340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:36.171917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:36.173129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:36.173642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:36.174847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] PATH_INFO: `/v3/users/8371789307454fa990f01f45caf0f9a1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:36.176683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] RBAC: Authorizing `identity:get_user(user_id=8371789307454fa990f01f45caf0f9a1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:36.182502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 162/312] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:36.182760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:36.184740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 151/313] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:35 2022] GET /identity/v3/users/8371789307454fa990f01f45caf0f9a1 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:36.185891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:36.193565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:36.296564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006784b-5d50-49cf-8a3f-c201b7a3772a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:36.308728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f11968-8e43-410b-8f57-0dee4d629d12 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:36.333139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:36.334187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:36.334438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:36.334722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] PATH_INFO: `/v3/users/fe40516f84fd4b1fabefb4710a3ad21f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:36.335924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] RBAC: Authorizing `identity:get_user(user_id=fe40516f84fd4b1fabefb4710a3ad21f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:36.337495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:36.343582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 163/314] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:36 2022] GET /identity/v3/users/fe40516f84fd4b1fabefb4710a3ad21f => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:36.346221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:36.349864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:36.351444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:36.351802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:36.352155 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:36.356309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:36.382177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:36.443301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:36.445412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:36.470765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c7cdf-365a-41c5-82db-340a13d435c9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:36.507203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:36.508087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:36.508364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:36.508638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] PATH_INFO: `/v3/system/users/fe40516f84fd4b1fabefb4710a3ad21f/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:36.510140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fe40516f84fd4b1fabefb4710a3ad21f, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:36.511582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:36.524619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 164/315] 10.222.0.58 () {58 vars in 1334 bytes} [Fri Jun 3 12:48:36 2022] PUT /identity/v3/system/users/fe40516f84fd4b1fabefb4710a3ad21f/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:36.579646 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 152/316] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:36.584884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:36.690757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:36.700268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243a724-3b22-4f1c-ab35-1373e7ea80fe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:36.740406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423446a-32bf-434f-a3b4-4ccf7df4a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:36.741285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423446a-32bf-434f-a3b4-4ccf7df4a04c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:36.741570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423446a-32bf-434f-a3b4-4ccf7df4a04c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:36.741850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423446a-32bf-434f-a3b4-4ccf7df4a04c None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:36.743961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423446a-32bf-434f-a3b4-4ccf7df4a04c None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:36.745845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423446a-32bf-434f-a3b4-4ccf7df4a04c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:36.748038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 165/317] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:36 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:36.753761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:36.798924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:36.868459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db04a53-1eaa-4fa0-a249-a0d212a8e9ab None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:36.905377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496b526-12a4-4b8a-b1ec-56df8fe495b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:36.906042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b526-12a4-4b8a-b1ec-56df8fe495b3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:36.906347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b526-12a4-4b8a-b1ec-56df8fe495b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:36.906618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b526-12a4-4b8a-b1ec-56df8fe495b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:36.907452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496b526-12a4-4b8a-b1ec-56df8fe495b3 None admin] RBAC: Adding query filter params (role.id=3df06c8b10b2453cb3c7bfa7139b4e20, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d, user.id=8371789307454fa990f01f45caf0f9a1) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:36.907814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496b526-12a4-4b8a-b1ec-56df8fe495b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:36.909266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496b526-12a4-4b8a-b1ec-56df8fe495b3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:36.915850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 153/318] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:48:36 2022] GET /identity/v3/role_assignments?user.id=8371789307454fa990f01f45caf0f9a1&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=3df06c8b10b2453cb3c7bfa7139b4e20 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:37.604246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0c6a-40ec-4390-974b-3b87ac55f747 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:37.604834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0c6a-40ec-4390-974b-3b87ac55f747 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:37.604834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0c6a-40ec-4390-974b-3b87ac55f747 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:37.606430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 166/319] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:37.611585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5944d-44c1-4279-86e8-59e3b670e2e6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:37.611840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5944d-44c1-4279-86e8-59e3b670e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:37.612160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5944d-44c1-4279-86e8-59e3b670e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:37.629559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fdc5944d-44c1-4279-86e8-59e3b670e2e6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:37.630786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fdc5944d-44c1-4279-86e8-59e3b670e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:37.708620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 154/320] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:37.731264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0c6a-40ec-4390-974b-3b87ac55f747 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:37.833935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0c6a-40ec-4390-974b-3b87ac55f747 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:37.867643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4e90f-2c0b-4f97-87e3-a074271d9c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:37.868443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4e90f-2c0b-4f97-87e3-a074271d9c5c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:37.868720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4e90f-2c0b-4f97-87e3-a074271d9c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:37.869003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4e90f-2c0b-4f97-87e3-a074271d9c5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:37.870514 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4e90f-2c0b-4f97-87e3-a074271d9c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:37.872085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4e90f-2c0b-4f97-87e3-a074271d9c5c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:37.873925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 167/321] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:37.879378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5944d-44c1-4279-86e8-59e3b670e2e6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:37.911180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:37.991929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5944d-44c1-4279-86e8-59e3b670e2e6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:38.027975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc067878-3df7-4fb7-a695-1a0f4e0d63b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:38.028646 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067878-3df7-4fb7-a695-1a0f4e0d63b5 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.028903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067878-3df7-4fb7-a695-1a0f4e0d63b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.029204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067878-3df7-4fb7-a695-1a0f4e0d63b5 None admin] PATH_INFO: `/v3/groups` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.029894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc067878-3df7-4fb7-a695-1a0f4e0d63b5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:38.031389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc067878-3df7-4fb7-a695-1a0f4e0d63b5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:38.048638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 155/322] 10.222.0.58 () {60 vars in 1134 bytes} [Fri Jun 3 12:48:37 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:38.302081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350fd5-559b-4b0d-a8dc-5f35b32f70db None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.302399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350fd5-559b-4b0d-a8dc-5f35b32f70db None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.302679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350fd5-559b-4b0d-a8dc-5f35b32f70db None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.304047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 168/323] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:38.310313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69315-0a12-4a74-9192-277242441d9f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.310689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69315-0a12-4a74-9192-277242441d9f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.311037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69315-0a12-4a74-9192-277242441d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.329466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-62a69315-0a12-4a74-9192-277242441d9f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:38.330709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62a69315-0a12-4a74-9192-277242441d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:38.404988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 156/324] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:38.427956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350fd5-559b-4b0d-a8dc-5f35b32f70db None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:38.459894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:38.553323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350fd5-559b-4b0d-a8dc-5f35b32f70db None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:38.590642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:38.591737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.592175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.592614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.604921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:38.612827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:38.613769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:38.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 169/325] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:38.622657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a69315-0a12-4a74-9192-277242441d9f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:38.653288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:38.758709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a69315-0a12-4a74-9192-277242441d9f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:38.800988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d135d37-2993-4a11-9429-61525d0f7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:38.802070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135d37-2993-4a11-9429-61525d0f7755 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.802598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135d37-2993-4a11-9429-61525d0f7755 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.803093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135d37-2993-4a11-9429-61525d0f7755 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.804199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d135d37-2993-4a11-9429-61525d0f7755 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:38.804721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d135d37-2993-4a11-9429-61525d0f7755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:38.806387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d135d37-2993-4a11-9429-61525d0f7755 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:38.817900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 157/326] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:38.824024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:38.842805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ea10-779c-4033-8404-8995569658f8 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.843450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ea10-779c-4033-8404-8995569658f8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.843935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ea10-779c-4033-8404-8995569658f8 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.845502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 158/327] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:48:38.854425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c36a-2035-416e-8ee6-8fe06506b725 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.855032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c36a-2035-416e-8ee6-8fe06506b725 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.855713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c36a-2035-416e-8ee6-8fe06506b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.876378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2216c36a-2035-416e-8ee6-8fe06506b725 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:38.878004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2216c36a-2035-416e-8ee6-8fe06506b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:38.935393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:38.950920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a92574-8a85-4e44-bcfe-f051cca726f1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:38.960216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 159/328] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:38.991235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:38.992132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:38.992418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:38.992700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] PATH_INFO: `/v3/users/50218285b0074ac89ebd682dd88c2c5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:38.993264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216c36a-2035-416e-8ee6-8fe06506b725 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:38.994078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] RBAC: Authorizing `identity:get_user(user_id=50218285b0074ac89ebd682dd88c2c5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:38.996359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:38.999529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 170/329] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:38 2022] GET /identity/v3/users/50218285b0074ac89ebd682dd88c2c5b => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:39.011705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:39.015178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:39.168238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216c36a-2035-416e-8ee6-8fe06506b725 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:39.214935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:39.215346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cc0d0-63fa-4a0b-9be4-7397fe0b0d19 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:39.215799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:39.216085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:39.216368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:39.229295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:39.238445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:39.239387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:39.240185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 160/330] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:39.247480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:39.304832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:39.305725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:39.306008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:39.306309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] PATH_INFO: `/v3/system/users/50218285b0074ac89ebd682dd88c2c5b/roles/3df06c8b10b2453cb3c7bfa7139b4e20` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:39.310887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=50218285b0074ac89ebd682dd88c2c5b, role_id=3df06c8b10b2453cb3c7bfa7139b4e20)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:39.312309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:39.329599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 171/331] 10.222.0.58 () {58 vars in 1334 bytes} [Fri Jun 3 12:48:39 2022] PUT /identity/v3/system/users/50218285b0074ac89ebd682dd88c2c5b/roles/3df06c8b10b2453cb3c7bfa7139b4e20 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:48:39.345449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:39.388249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebe53c-4e71-4e49-9b69-b916c7afc631 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:39.428903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:39.429884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:39.430365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:39.430836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:39.431771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:39.432262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:39.433962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:39.446634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 161/332] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:39.452940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:39.490427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:39.615122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387e676-a775-4cea-9935-3b0b8525db4e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:39.674342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd88ade-0b59-476f-980d-8f053c08101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:39.675262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88ade-0b59-476f-980d-8f053c08101c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:39.675547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88ade-0b59-476f-980d-8f053c08101c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:39.675825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88ade-0b59-476f-980d-8f053c08101c None admin] PATH_INFO: `/v3/users/fe40516f84fd4b1fabefb4710a3ad21f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:39.683305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd88ade-0b59-476f-980d-8f053c08101c None admin] RBAC: Authorizing `identity:get_user(user_id=fe40516f84fd4b1fabefb4710a3ad21f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:39.684864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd88ade-0b59-476f-980d-8f053c08101c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:39.686729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 172/333] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:39 2022] GET /identity/v3/users/fe40516f84fd4b1fabefb4710a3ad21f => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:39.692758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:39.827883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01691-f64e-49b6-b83e-7d5432ed5ae3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:39.865587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4d91e-627e-444f-9c88-c408a8071156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:39.866291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4d91e-627e-444f-9c88-c408a8071156 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:39.866583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4d91e-627e-444f-9c88-c408a8071156 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:39.866861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4d91e-627e-444f-9c88-c408a8071156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:39.867711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4d91e-627e-444f-9c88-c408a8071156 None admin] RBAC: Adding query filter params (role.id=de38664d376f45f6a446103b7f17e7b3, user.id=fe40516f84fd4b1fabefb4710a3ad21f, scope.system=all) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:39.868025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4d91e-627e-444f-9c88-c408a8071156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:39.869828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4d91e-627e-444f-9c88-c408a8071156 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:39.871671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:39.885951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 162/334] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 3 12:48:39 2022] GET /identity/v3/role_assignments?user.id=fe40516f84fd4b1fabefb4710a3ad21f&scope.system=all&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:41.114143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6867ae-358a-4185-a4ae-a4c1a600be2e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.114693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6867ae-358a-4185-a4ae-a4c1a600be2e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.114772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6867ae-358a-4185-a4ae-a4c1a600be2e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.116107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 173/335] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:41.122167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc62da-5baa-476e-a0d3-301ab3b66aff None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.123074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc62da-5baa-476e-a0d3-301ab3b66aff None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.123583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc62da-5baa-476e-a0d3-301ab3b66aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.135538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734163-3dcf-4b3e-b4f5-12df3b7c56af None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.136160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734163-3dcf-4b3e-b4f5-12df3b7c56af None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.136751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734163-3dcf-4b3e-b4f5-12df3b7c56af None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.139272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 174/336] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:41.144389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-badc62da-5baa-476e-a0d3-301ab3b66aff None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:41.144626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846e2e-313e-4f15-82a2-c94bbd583269 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.145121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846e2e-313e-4f15-82a2-c94bbd583269 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.145617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-badc62da-5baa-476e-a0d3-301ab3b66aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:41.145723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846e2e-313e-4f15-82a2-c94bbd583269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.179073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-73846e2e-313e-4f15-82a2-c94bbd583269 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:41.180805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-73846e2e-313e-4f15-82a2-c94bbd583269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:41.273033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 163/337] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:41.308953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 175/338] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:41.323730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc62da-5baa-476e-a0d3-301ab3b66aff None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:41.344441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73846e2e-313e-4f15-82a2-c94bbd583269 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:41.378578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:41.564336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc62da-5baa-476e-a0d3-301ab3b66aff None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:41.573977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73846e2e-313e-4f15-82a2-c94bbd583269 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:41.594547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:41.614628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:41.615516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.615797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.616073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.642921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:41.660340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:41.661160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.661448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.661728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:41.662545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:41.663402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:41.664191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:41.666297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 164/339] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:41.678705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:41.687102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:41.687968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:41.688765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 176/340] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:41.691374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:41.697398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:41.842103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:41.874672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75d559-94e4-452a-9028-032dc0124fc9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:41.898643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac74f-b42f-4330-b2da-df5b53d085f8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:41.933456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:41.934175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.934545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.934878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.935647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:41.935959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:41.937383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:41.954621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 165/341] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:41.960363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:41.979001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:41.980072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:41.980647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:41.981149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:41.982126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:41.982655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:41.984277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:41.997928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 177/342] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:42.003782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:42.046536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:42.106638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1c409-c85b-4d52-b754-769988969e88 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:42.144000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:42.144659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:42.145220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:42.145716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:42.219307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:42.221229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:42.226655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a013bf-62d2-4dac-bc90-3c7d521f3c9b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:42.282804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:42.295057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:42.295725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:42.296009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:42.296292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:42.316254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:42.329366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 166/343] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:42.334674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:42.412265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:42.413873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:42.498575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6b83-997f-45a3-8dff-db59d8c0e33e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:42.568395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 178/344] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:42.570027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:42.571203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:42.571700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:42.572193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:42.573847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:42.574886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:42.576646 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:42.578834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 167/345] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:42 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:42.583896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:42.606491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:42.638558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:42.722496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c467e70-756a-4bf0-8bd9-44191f9b8574 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:42.741472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d744d0-4c2b-4502-919a-c6149bad7084 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:42.791870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:42.792742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:42.793291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:42.793990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:42.795034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:42.796708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:42.798487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 179/346] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:42 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:42.800373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:42.801274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:42.801563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:42.801840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:42.804151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:42.816369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:42.817884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:42.820022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 168/347] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:42 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:42.827450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:42.937302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:42.970616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7635150-3df5-480e-af65-9ebab579fdf3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:43.005496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe953e4-88d5-4c48-912a-8e5dfb81122d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:43.016925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d2724-2d29-4f7f-ba70-0368a525d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:43.017611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d2724-2d29-4f7f-ba70-0368a525d272 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.017892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d2724-2d29-4f7f-ba70-0368a525d272 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.018189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d2724-2d29-4f7f-ba70-0368a525d272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.019039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d2724-2d29-4f7f-ba70-0368a525d272 None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:43.019356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d2724-2d29-4f7f-ba70-0368a525d272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:43.023280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d2724-2d29-4f7f-ba70-0368a525d272 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:43.025418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:43.037014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 169/348] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:42 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=66551becb6cc4504bfbd74555d898a06 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:43.038535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d189a-5573-4dc9-8c98-9eb2e41b120b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.039267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d189a-5573-4dc9-8c98-9eb2e41b120b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.039571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d189a-5573-4dc9-8c98-9eb2e41b120b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.040885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 170/349] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:43.049665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305332-1e39-476b-842a-84323deba693 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.049840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305332-1e39-476b-842a-84323deba693 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.050205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305332-1e39-476b-842a-84323deba693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.090929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-48305332-1e39-476b-842a-84323deba693 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:43.092200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:43.093110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.093394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.093672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.095045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-48305332-1e39-476b-842a-84323deba693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:43.097853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:43.099378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:43.101158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 180/350] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:42 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:43.107557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:43.298161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 171/351] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:43.299557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35687-7ad0-4c73-af8d-ab1130cc2e39 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.299910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35687-7ad0-4c73-af8d-ab1130cc2e39 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.300124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35687-7ad0-4c73-af8d-ab1130cc2e39 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.306662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 172/352] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:43.321956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b89c-5f14-405e-9dfb-ab9ea5a84265 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.322474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b89c-5f14-405e-9dfb-ab9ea5a84265 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.322936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b89c-5f14-405e-9dfb-ab9ea5a84265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.359202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6171b89c-5f14-405e-9dfb-ab9ea5a84265 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:43.360476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6171b89c-5f14-405e-9dfb-ab9ea5a84265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:43.367287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaa94e-03cb-4ec6-b404-a859fce678d5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:43.418311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:43.419413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.419841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.420255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.421250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:43.421705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:43.423521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:43.438143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 181/353] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:43 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 260 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:43.439857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:43.456802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:43.466679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 173/354] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:43.468552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9997d1-60ef-420c-b997-629b57e97f2e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.468848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9997d1-60ef-420c-b997-629b57e97f2e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.469131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9997d1-60ef-420c-b997-629b57e97f2e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.476479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 174/355] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:43.481248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72b235-e15c-4f84-b444-a35cca8b8811 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.481584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72b235-e15c-4f84-b444-a35cca8b8811 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.481820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72b235-e15c-4f84-b444-a35cca8b8811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.496730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:43.516167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9e72b235-e15c-4f84-b444-a35cca8b8811 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:43.517406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9e72b235-e15c-4f84-b444-a35cca8b8811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:43.573733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932307-9d2a-4325-8876-03967c11e669 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:43.614923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:43.616232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.616803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.617270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.631302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:43.634259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 175/356] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:43.635582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72b235-e15c-4f84-b444-a35cca8b8811 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:43.641926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:43.642950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:43.643742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:43.646503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 182/357] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:43.684510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:43.785195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72b235-e15c-4f84-b444-a35cca8b8811 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:43.818438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:43.825506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:43.827538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382ac76-1887-4ccf-afac-7913884301af None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:43.833004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaae2d8-6c6a-4cbc-895f-638ecc9a9907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:43.834045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaae2d8-6c6a-4cbc-895f-638ecc9a9907 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.835454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaae2d8-6c6a-4cbc-895f-638ecc9a9907 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.835454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaae2d8-6c6a-4cbc-895f-638ecc9a9907 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.847829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaae2d8-6c6a-4cbc-895f-638ecc9a9907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ffaae2d8-6c6a-4cbc-895f-638ecc9a9907 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:43.857692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:43.859084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:43.860055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 176/358] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:43.861188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e42e8d-9093-4de3-9dab-22b8827c07eb None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.861188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e42e8d-9093-4de3-9dab-22b8827c07eb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.861188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e42e8d-9093-4de3-9dab-22b8827c07eb None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.862101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 177/359] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:43.867101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e42e8d-9093-4de3-9dab-22b8827c07eb None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:43.878233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6749c85-9b18-405b-8ed8-1b2b0676a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:43.879140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6749c85-9b18-405b-8ed8-1b2b0676a629 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.879426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6749c85-9b18-405b-8ed8-1b2b0676a629 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.879706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6749c85-9b18-405b-8ed8-1b2b0676a629 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.880465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6749c85-9b18-405b-8ed8-1b2b0676a629 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:43.880766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6749c85-9b18-405b-8ed8-1b2b0676a629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:43.883960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6749c85-9b18-405b-8ed8-1b2b0676a629 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:43.897521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 183/360] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:43.899220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf04b8-2068-48f2-8134-957b64926b2a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:43.899653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf04b8-2068-48f2-8134-957b64926b2a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:43.900093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf04b8-2068-48f2-8134-957b64926b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:43.921516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0eaf04b8-2068-48f2-8134-957b64926b2a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:43.922999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0eaf04b8-2068-48f2-8134-957b64926b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:44.013189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 184/361] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:44.014358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf04b8-2068-48f2-8134-957b64926b2a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.037642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e42e8d-9093-4de3-9dab-22b8827c07eb None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.087650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.088803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.089309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.089850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.104456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:44.113848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:44.114805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:44.115675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:44.121409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 178/362] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:44.123245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.141696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.156545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf04b8-2068-48f2-8134-957b64926b2a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.198832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.199641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.199929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.200199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.200958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:44.201262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.202697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:44.214430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 185/363] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:44.215060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.215178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.271163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd86e08-d39c-4619-acc2-6dd0a5d4947c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.310049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.311533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.312047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.312618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.321965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5cc7a-633e-4ad1-a233-df12998a1ad6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.357798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.358568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.358851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.359125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.371846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:44.380672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:44.381602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:44.382441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 186/364] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:44.383100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.397370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.399412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.400760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:44.478583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.493537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd22a4-d298-44ee-b154-51a77f8a92af None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.511711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 179/365] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:44.512756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.534351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.535044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.535334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.535622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.537189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:44.537189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.540334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:44.548092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 187/366] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:44.549200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.630048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688438-23b6-42bb-bafd-e0c5c61fac79 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.637895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.664117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a7f53-6064-4d88-8042-c458b234aec8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.668600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.669500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.669787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.670064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] PATH_INFO: `/v3/users/50218285b0074ac89ebd682dd88c2c5b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.671335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] RBAC: Authorizing `identity:get_user(user_id=50218285b0074ac89ebd682dd88c2c5b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.673022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:44.674922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 180/367] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/users/50218285b0074ac89ebd682dd88c2c5b => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:44.675765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.696278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.701836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.703055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.703344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.703848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.704895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:44.705210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.706644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:44.716520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 188/368] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:44.717374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.790352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256c89b-038d-43e3-8bdf-cedc26969266 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.823935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d6c72-5035-451e-88ae-7773b3fd3d7c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.830954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.831945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.832234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.832512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.833792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.835375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:44.837628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 181/369] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:44.838608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:44.859535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.860201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.860489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.860763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.871782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.930650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:44.937903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.939523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:44.947440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605429d-37fd-4973-a22c-b82485583cc9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:44.983356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:44.984032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:44.984321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:44.984597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:44.985430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] RBAC: Adding query filter params (role.id=3df06c8b10b2453cb3c7bfa7139b4e20, user.id=50218285b0074ac89ebd682dd88c2c5b, scope.system=all) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:44.985748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:44.987370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.001841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 182/370] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/role_assignments?user.id=50218285b0074ac89ebd682dd88c2c5b&scope.system=all&role.id=3df06c8b10b2453cb3c7bfa7139b4e20 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.008703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.060740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 189/371] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:45.062060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.122584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:45.136463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db177d-cde2-4f49-8cef-5d6984bc8a31 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.178950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226ea26-2047-48f6-b3c4-65c062e70fad None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.196005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.196637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.196921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.197238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.214566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:45.222627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.223776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.224162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.224544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.225865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.227679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.229864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 190/372] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.231025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.278350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.279976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.351165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625af1-e390-4276-98d8-4c0d9c6f8cce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.366702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:45.392800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.393844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.394283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.394680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] PATH_INFO: `/v3/projects/8cee784ec8864757a1c8441df24c7f48` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.395684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 183/373] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:45.396057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] RBAC: Authorizing `identity:get_project(project_id=8cee784ec8864757a1c8441df24c7f48)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.396316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.397678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.400054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 191/374] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/projects/8cee784ec8864757a1c8441df24c7f48 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.400957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.445306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:45.504107 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2553d19-1863-4e94-bce7-683d3756a4bf None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.514588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707d6c-68fb-4c91-9d3a-ec393046e822 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.541255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.541929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.542246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.542523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.543400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:45.543716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.545260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.552318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 184/375] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.552925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.554600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.555576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.555859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.556162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.557473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.559561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.561806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 192/376] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.568058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.624282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:45.675844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08fef8-6fd2-4c8c-a707-b98db08da658 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.687220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:45.719250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.720161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.720449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.720729 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] PATH_INFO: `/v3/groups/9f7a433b708f4cd6869289f81c64305c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.727247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] RBAC: Authorizing `identity:get_group(group_id=9f7a433b708f4cd6869289f81c64305c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.728759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.731152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 185/377] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/groups/9f7a433b708f4cd6869289f81c64305c => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.737319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.743721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd917d-bf76-45a9-b29e-cdf1dee354c1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.798982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.799791 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.800082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.800354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.801656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.803188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.805204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 193/378] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.811621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:45.856743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b578eb-5ed5-4e92-b7cf-6a0cc73bf92c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.895720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735f5f3-8ba2-46f4-afea-12e6e91fc680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.896386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f5f3-8ba2-46f4-afea-12e6e91fc680 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.896673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f5f3-8ba2-46f4-afea-12e6e91fc680 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.897056 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f5f3-8ba2-46f4-afea-12e6e91fc680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.897898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735f5f3-8ba2-46f4-afea-12e6e91fc680 None admin] RBAC: Adding query filter params (group.id=9f7a433b708f4cd6869289f81c64305c, role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=8cee784ec8864757a1c8441df24c7f48) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:45.898236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735f5f3-8ba2-46f4-afea-12e6e91fc680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.899790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735f5f3-8ba2-46f4-afea-12e6e91fc680 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.906498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 186/379] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/role_assignments?group.id=9f7a433b708f4cd6869289f81c64305c&scope.project.id=8cee784ec8864757a1c8441df24c7f48&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:45.922185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36159b72-eb47-4692-aa63-467c9ce18701 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:45.934680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:45.969659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e5896-08c0-4eb4-ae9e-2e35abb29999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:45.970365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5896-08c0-4eb4-ae9e-2e35abb29999 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:45.970651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5896-08c0-4eb4-ae9e-2e35abb29999 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:45.970945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5896-08c0-4eb4-ae9e-2e35abb29999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:45.971784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e5896-08c0-4eb4-ae9e-2e35abb29999 None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:45.972099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e5896-08c0-4eb4-ae9e-2e35abb29999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:45.973589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e5896-08c0-4eb4-ae9e-2e35abb29999 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:45.980689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 194/380] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:45 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=66551becb6cc4504bfbd74555d898a06 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:46.190310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106fd3-0c7c-4ee8-bb79-49105eca37b2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:46.190685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106fd3-0c7c-4ee8-bb79-49105eca37b2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:46.190854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106fd3-0c7c-4ee8-bb79-49105eca37b2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:46.192425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 187/381] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:46.198520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5daf7-6344-402f-ae2b-62f3555eddf9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:46.198818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5daf7-6344-402f-ae2b-62f3555eddf9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:46.199071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5daf7-6344-402f-ae2b-62f3555eddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:46.218161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-15a5daf7-6344-402f-ae2b-62f3555eddf9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:46.219394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-15a5daf7-6344-402f-ae2b-62f3555eddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:46.323321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 195/382] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:46.348117 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75106fd3-0c7c-4ee8-bb79-49105eca37b2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:46.392154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:46.478427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75106fd3-0c7c-4ee8-bb79-49105eca37b2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:46.514324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:46.515148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:46.515432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:46.515707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:46.526573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:46.537305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:46.541849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:46.544552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 188/383] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:46.546172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5daf7-6344-402f-ae2b-62f3555eddf9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:46.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5daf7-6344-402f-ae2b-62f3555eddf9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:46.663125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:46.700136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72129e6b-013e-4fde-90fb-0a5d35728937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:46.700799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129e6b-013e-4fde-90fb-0a5d35728937 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:46.701090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129e6b-013e-4fde-90fb-0a5d35728937 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:46.701367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129e6b-013e-4fde-90fb-0a5d35728937 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:46.702209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72129e6b-013e-4fde-90fb-0a5d35728937 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:46.702523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72129e6b-013e-4fde-90fb-0a5d35728937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:46.704002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72129e6b-013e-4fde-90fb-0a5d35728937 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:46.714675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 196/384] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:46.722613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:46.763506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4520a1-a2d4-4917-b218-283ce178ddaa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:46.763795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4520a1-a2d4-4917-b218-283ce178ddaa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:46.764041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4520a1-a2d4-4917-b218-283ce178ddaa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:46.765565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 197/385] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:46.774322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7ca65-ea61-457b-85ee-b1f33591db35 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:46.775318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7ca65-ea61-457b-85ee-b1f33591db35 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:46.775784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7ca65-ea61-457b-85ee-b1f33591db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:46.797865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-25b7ca65-ea61-457b-85ee-b1f33591db35 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:46.800053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25b7ca65-ea61-457b-85ee-b1f33591db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:46.854945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:46.863279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354308ab-ea98-43ef-9fbb-39375bcd5268 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:46.897483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 198/386] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:46.915264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:46.916389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:46.916839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:46.917250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:46.918753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:46.920361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:46.922521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 189/387] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:46 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:46.928272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7ca65-ea61-457b-85ee-b1f33591db35 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:46.937453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:47.097070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:47.100645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2d7e-ef99-4f3e-92ff-6ec82a91b47d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:47.112949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7ca65-ea61-457b-85ee-b1f33591db35 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:47.142403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:47.143592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:47.144085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:47.144549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:47.158891 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:47.160371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:47.161471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:47.166131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:47.166629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:47.168228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:47.169916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:47.171866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 199/388] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:46 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:47.180254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:47.181135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:47.181943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:47.184645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 190/389] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:47.190543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:47.195432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:47.242890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:47.330280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0cdea-8004-4d28-9b9f-501df3d037f2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:47.374440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:47.375044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:47.375332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:47.375609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:47.376367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:47.376679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:47.378071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:47.387391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 200/390] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:47.395150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:47.436384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:47.458799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9572-70da-479d-9395-9244f52cafdd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:47.519334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:47.520563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:47.520854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:47.521418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/groups/c509138038b74ebd9672698f96402ed1/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:47.523890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbf23601e34aa3b5f779f7742e321c, group_id=c509138038b74ebd9672698f96402ed1, role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:47.526647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:47.554058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5b212-6d0b-4b31-b50e-f6d582dada2c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:47.563829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 191/391] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 3 12:48:47 2022] PUT /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/groups/c509138038b74ebd9672698f96402ed1/roles/66551becb6cc4504bfbd74555d898a06 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:48:47.609385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:47.610396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:47.610684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:47.610974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:47.614335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:47.616045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:47.618088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 201/392] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:47 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:47.624914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:47.734504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:47.762541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3c8f-c0f0-4c9a-8609-5a7707b9f052 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:47.805885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d5d7f-6286-456c-b50d-a02e16eeed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:47.806807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5d7f-6286-456c-b50d-a02e16eeed5d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:47.807148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5d7f-6286-456c-b50d-a02e16eeed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:47.807427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5d7f-6286-456c-b50d-a02e16eeed5d None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:47.808871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d5d7f-6286-456c-b50d-a02e16eeed5d None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:47.810977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d5d7f-6286-456c-b50d-a02e16eeed5d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:47.813115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 192/393] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:47 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:47.818499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:47.929954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:47.938050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3a158-e430-46b7-a938-97d8c95ffa34 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:47.975084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01aa96-3ee7-4123-9b41-dfee47f758d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:47.975975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01aa96-3ee7-4123-9b41-dfee47f758d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:47.976260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01aa96-3ee7-4123-9b41-dfee47f758d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:47.976598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01aa96-3ee7-4123-9b41-dfee47f758d7 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/groups/c509138038b74ebd9672698f96402ed1/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:47.978643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01aa96-3ee7-4123-9b41-dfee47f758d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbf23601e34aa3b5f779f7742e321c, group_id=c509138038b74ebd9672698f96402ed1, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:47.980103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01aa96-3ee7-4123-9b41-dfee47f758d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:48.007085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 202/394] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 3 12:48:47 2022] PUT /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c/groups/c509138038b74ebd9672698f96402ed1/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:48.684278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b052-d49c-4a57-877a-3e1343e26dc7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:48.685416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b052-d49c-4a57-877a-3e1343e26dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:48.685901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b052-d49c-4a57-877a-3e1343e26dc7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:48.687877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 193/395] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:48.694341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec4fe-0a9e-4722-8a8a-28963ff7176a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:48.694806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec4fe-0a9e-4722-8a8a-28963ff7176a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:48.694880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec4fe-0a9e-4722-8a8a-28963ff7176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:48.712741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0f1ec4fe-0a9e-4722-8a8a-28963ff7176a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:48.713929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f1ec4fe-0a9e-4722-8a8a-28963ff7176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:48.745569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a030-da3b-40ab-881f-29cff2c12c53 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:48.746457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a030-da3b-40ab-881f-29cff2c12c53 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:48.747038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a030-da3b-40ab-881f-29cff2c12c53 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:48.750952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 194/396] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:48.776785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ab14-15c8-4d21-9fda-6346afca9709 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:48.777511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ab14-15c8-4d21-9fda-6346afca9709 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:48.778089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ab14-15c8-4d21-9fda-6346afca9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:48.790855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 203/397] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:48.811248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ab60ab14-15c8-4d21-9fda-6346afca9709 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:48.812700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ab60ab14-15c8-4d21-9fda-6346afca9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:48.850948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ec4fe-0a9e-4722-8a8a-28963ff7176a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:48.921089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 195/398] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:48.951585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ab14-15c8-4d21-9fda-6346afca9709 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:48.991660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:49.022765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ec4fe-0a9e-4722-8a8a-28963ff7176a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.085873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.086960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.087402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.087840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.092567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:49.111966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:49.125372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:49.126347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:49.127150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:49.129913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 204/399] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:49.132911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ab14-15c8-4d21-9fda-6346afca9709 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.135655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.198577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.199775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.200400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.201385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.224775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:49.233971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:49.234898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:49.235697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:49.243224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 196/400] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:49.249522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.318857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e93f6-b3f8-4cf5-a997-d91dd2e4f24d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.369165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077b9a6-2dc9-4489-9a7a-ae308415db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.369856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077b9a6-2dc9-4489-9a7a-ae308415db65 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.370822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077b9a6-2dc9-4489-9a7a-ae308415db65 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.370928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077b9a6-2dc9-4489-9a7a-ae308415db65 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.371709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077b9a6-2dc9-4489-9a7a-ae308415db65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:49.372018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077b9a6-2dc9-4489-9a7a-ae308415db65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:49.373404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077b9a6-2dc9-4489-9a7a-ae308415db65 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:49.383015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 205/401] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:49.384277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea569-0d8e-499f-9b75-a6f8b82e5e18 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.384565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea569-0d8e-499f-9b75-a6f8b82e5e18 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.384839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea569-0d8e-499f-9b75-a6f8b82e5e18 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.390921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 206/402] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:49.390921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea569-0d8e-499f-9b75-a6f8b82e5e18 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.396920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526f99-88d3-418c-8ef0-9fd8a541e2b6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.398421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:49.434434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28410467-a1b8-437e-802a-a9ffe1ad488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.435556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410467-a1b8-437e-802a-a9ffe1ad488b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.436088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410467-a1b8-437e-802a-a9ffe1ad488b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.436556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410467-a1b8-437e-802a-a9ffe1ad488b None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.437507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28410467-a1b8-437e-802a-a9ffe1ad488b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:49.438042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28410467-a1b8-437e-802a-a9ffe1ad488b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:49.439664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28410467-a1b8-437e-802a-a9ffe1ad488b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:49.449485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 197/403] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:49.451249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62f1c-184a-4b4c-8291-72d6e21afba9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.451739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62f1c-184a-4b4c-8291-72d6e21afba9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.452238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62f1c-184a-4b4c-8291-72d6e21afba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.458860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:49.470465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-79b62f1c-184a-4b4c-8291-72d6e21afba9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:49.472480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-79b62f1c-184a-4b4c-8291-72d6e21afba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:49.570286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 198/404] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:49.571478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62f1c-184a-4b4c-8291-72d6e21afba9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.645465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea569-0d8e-499f-9b75-a6f8b82e5e18 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.681629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586419-2374-4779-9979-f909d89cf704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.682874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586419-2374-4779-9979-f909d89cf704 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.683377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586419-2374-4779-9979-f909d89cf704 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.683865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586419-2374-4779-9979-f909d89cf704 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.685431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42586419-2374-4779-9979-f909d89cf704 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:49.687121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42586419-2374-4779-9979-f909d89cf704 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:49.689442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 207/405] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:49.690437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586419-2374-4779-9979-f909d89cf704 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.691233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62f1c-184a-4b4c-8291-72d6e21afba9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.727983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.728903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.729195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.729489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] PATH_INFO: `/v3/groups/9f7a433b708f4cd6869289f81c64305c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.731153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] RBAC: Authorizing `identity:get_group(group_id=9f7a433b708f4cd6869289f81c64305c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:49.732518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:49.734647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 199/406] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/groups/9f7a433b708f4cd6869289f81c64305c => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:49.735542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.738347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:49.786507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:49.807325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586419-2374-4779-9979-f909d89cf704 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.841721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbf36a-5f50-4030-993a-dcc6db37e27e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:49.850649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.851583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.851957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.852760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.869567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:49.883713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:49.884696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:49.885490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 208/407] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:49.886799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.891911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:49.893008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:49.893294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:49.893577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:49.896268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:49.902166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:49.902166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 200/408] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:49.902166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:49.978661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:50.010510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf622910-1771-4470-a48d-c3d4271d624a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.025297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0547-7a52-4a06-9202-153c161f076a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.056161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.057439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.058309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.059110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.060094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:50.060605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:50.062243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:50.062895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.063831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.064116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.064521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] PATH_INFO: `/v3/projects/8cee784ec8864757a1c8441df24c7f48` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.065816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] RBAC: Authorizing `identity:get_project(project_id=8cee784ec8864757a1c8441df24c7f48)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:50.067263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:50.077252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 209/410] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/projects/8cee784ec8864757a1c8441df24c7f48 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:50.077252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:50.077986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 201/410] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:50.079712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:50.081104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:50.189720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923091-0237-4cf0-8a5c-113af773fabf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.217718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f1325-d511-4c1b-aae9-d9828f373310 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.230305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.231983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.232189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.232557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/groups/c509138038b74ebd9672698f96402ed1/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.234675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e033f2a03224efcbefc45d2fd80e48d, group_id=c509138038b74ebd9672698f96402ed1, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:50.236407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:50.252046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 210/411] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 3 12:48:50 2022] PUT /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/groups/c509138038b74ebd9672698f96402ed1/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:50.253303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:50.254181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:50.261044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.262461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.263391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.264157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] PATH_INFO: `/v3/projects/8cee784ec8864757a1c8441df24c7f48/groups/9f7a433b708f4cd6869289f81c64305c/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.266755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cee784ec8864757a1c8441df24c7f48, group_id=9f7a433b708f4cd6869289f81c64305c, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:50.268532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:50.292422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 202/412] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 3 12:48:50 2022] PUT /identity/v3/projects/8cee784ec8864757a1c8441df24c7f48/groups/9f7a433b708f4cd6869289f81c64305c/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:48:50.337564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:50.385204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7757-50dc-4978-8781-9d358801e8d8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.425589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5b5e-9902-441b-a32a-160055886149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.426542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5b5e-9902-441b-a32a-160055886149 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.426828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5b5e-9902-441b-a32a-160055886149 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.427111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5b5e-9902-441b-a32a-160055886149 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.428431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a5b5e-9902-441b-a32a-160055886149 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:50.429967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a5b5e-9902-441b-a32a-160055886149 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:50.434231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 211/413] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:50 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:50.438137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:50.527447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295213-461d-42df-8d96-7a260b73cec1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.527824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295213-461d-42df-8d96-7a260b73cec1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.528056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295213-461d-42df-8d96-7a260b73cec1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.529436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 212/414] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:48:50.538394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a924cd-43cc-4741-8320-a2a12f70ef3e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.538717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a924cd-43cc-4741-8320-a2a12f70ef3e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.538950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a924cd-43cc-4741-8320-a2a12f70ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.562986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f9a924cd-43cc-4741-8320-a2a12f70ef3e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:50.565000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9a924cd-43cc-4741-8320-a2a12f70ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:50.582727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b99f3f-0c9d-4230-9c91-727667561166 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.634264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.635167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.635451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.635721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.637986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:50.639535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:50.641669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 203/415] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:50 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:50.647365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:50.660204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 213/416] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:50.690952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a924cd-43cc-4741-8320-a2a12f70ef3e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:50.726237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:50.792172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e3c88-30d6-428a-83de-cbf9e55cf6b7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.822288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a924cd-43cc-4741-8320-a2a12f70ef3e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:50.824775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:50.827957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.829220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.829220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.829370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/groups/c509138038b74ebd9672698f96402ed1/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.831830 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] RBAC: Authorizing `identity:create_grant(project_id=3e033f2a03224efcbefc45d2fd80e48d, group_id=c509138038b74ebd9672698f96402ed1, role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:50.833287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:50.848774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 204/417] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 3 12:48:50 2022] PUT /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d/groups/c509138038b74ebd9672698f96402ed1/roles/66551becb6cc4504bfbd74555d898a06 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:48:50.881526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585324ba-9765-48dc-b538-70ce0b4b61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:50.882410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585324ba-9765-48dc-b538-70ce0b4b61e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:50.882698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585324ba-9765-48dc-b538-70ce0b4b61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:50.882974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585324ba-9765-48dc-b538-70ce0b4b61e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:50.900148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585324ba-9765-48dc-b538-70ce0b4b61e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-585324ba-9765-48dc-b538-70ce0b4b61e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:50.909202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:50.910232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:50.911014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:50.911606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 214/418] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:50.920174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:51.012497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55752-dd56-43d1-872c-1216b7246b98 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.012857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55752-dd56-43d1-872c-1216b7246b98 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.013064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55752-dd56-43d1-872c-1216b7246b98 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.014838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 215/419] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:51.035010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ca3a-05c5-4ffa-9f3f-d2f73265572c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.035655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ca3a-05c5-4ffa-9f3f-d2f73265572c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.036130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ca3a-05c5-4ffa-9f3f-d2f73265572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.047180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88160429-33b5-472c-9e37-2ad66783914e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:51.065192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dd24ca3a-05c5-4ffa-9f3f-d2f73265572c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:51.066428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd24ca3a-05c5-4ffa-9f3f-d2f73265572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:51.068927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:51.084859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:51.085547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.085839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.090813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.091906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:51.092443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:51.095351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:51.110910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 205/420] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:51.116867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:51.192654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 216/421] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:51.218528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ca3a-05c5-4ffa-9f3f-d2f73265572c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:51.267984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddefbb1-a5bb-4b0c-83ed-c795d37744c7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:51.274729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:51.305891 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:51.306637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.306924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.307203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.358723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:51.378326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:51.379952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:51.392285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ca3a-05c5-4ffa-9f3f-d2f73265572c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:51.481307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 206/422] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:51.482814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:51.483637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.483918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.484191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.487223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:51.507056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:51.522865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:51.523824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:51.524595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 217/423] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:51.529821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:51.600696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:51.607691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ef60-3342-4d02-84f7-b049ab46b25c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:51.655016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:51.657055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.659207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.659692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.662067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:51.665172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:51.676533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 207/424] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:51 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:51.691167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:51.728595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e82a23-51b6-4851-af91-33a463ff6e1c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:51.741141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:51.791815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:51.792947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.793502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.793977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.794948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:51.795452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:51.797056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:51.806874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 218/425] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:51.813995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:51.905976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dff7f-a1e2-416a-a934-9a1a21853a84 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:51.966281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:51.967171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:51.967445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:51.967717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:51.969894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:51.971404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:51.973249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 208/426] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:51 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:51.985705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:52.004463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a767fe-6b3c-4a15-ad40-dd41dd8e779b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:52.024402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:52.075032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:52.075821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:52.076109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:52.076384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:52.117056 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ddc8-f13d-46d5-9504-9e4674dafd92 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:52.153168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:52.153827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:52.154126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:52.154406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:52.155666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:52.156037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:52.157450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:52.163962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 209/427] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:51 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=66551becb6cc4504bfbd74555d898a06 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:52.229854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:52.284563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:52.286097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:52.412378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 219/428] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:52.417678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:52.502867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:52.523663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a25d-3821-4f0a-9d61-0e00759bfd90 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:52.558969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:52.559926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:52.560242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:52.560521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] PATH_INFO: `/v3/projects/c0cbf23601e34aa3b5f779f7742e321c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:52.561745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] RBAC: Authorizing `identity:get_project(project_id=c0cbf23601e34aa3b5f779f7742e321c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:52.563236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:52.565251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 210/429] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:52 2022] GET /identity/v3/projects/c0cbf23601e34aa3b5f779f7742e321c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:52.570591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:52.653322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:52.688031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd713e2-be64-484f-a01e-e5f340f353d3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:52.725383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacbcdc-9013-48a2-8c4f-afbea9a033c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:52.726330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacbcdc-9013-48a2-8c4f-afbea9a033c8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:52.726613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacbcdc-9013-48a2-8c4f-afbea9a033c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:52.726888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacbcdc-9013-48a2-8c4f-afbea9a033c8 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:52.728069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacbcdc-9013-48a2-8c4f-afbea9a033c8 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:52.729509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacbcdc-9013-48a2-8c4f-afbea9a033c8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:52.731615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 220/430] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:52 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:52.737231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:52.844129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296ac9a-2a79-4f13-a31f-0a3722a0b17d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:52.878913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c326b4-da61-416f-950d-ab9708491733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:52.879634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c326b4-da61-416f-950d-ab9708491733 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:52.879914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c326b4-da61-416f-950d-ab9708491733 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:52.880189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c326b4-da61-416f-950d-ab9708491733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:52.881071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c326b4-da61-416f-950d-ab9708491733 None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=c0cbf23601e34aa3b5f779f7742e321c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:52.881385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c326b4-da61-416f-950d-ab9708491733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:52.882859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c326b4-da61-416f-950d-ab9708491733 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:52.889466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 211/431] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:52 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=c0cbf23601e34aa3b5f779f7742e321c&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:52.923316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96a703-da33-44bc-9701-2394ce486c25 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:52.923650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96a703-da33-44bc-9701-2394ce486c25 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:52.923879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96a703-da33-44bc-9701-2394ce486c25 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:52.925475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 221/432] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:52.931199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a19a2-1037-497b-999c-92b845b28b2a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:52.931703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a19a2-1037-497b-999c-92b845b28b2a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:52.931914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a19a2-1037-497b-999c-92b845b28b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:52.950636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-128a19a2-1037-497b-999c-92b845b28b2a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:52.951784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-128a19a2-1037-497b-999c-92b845b28b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:52.963482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:53.030044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 212/433] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:53.053931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96a703-da33-44bc-9701-2394ce486c25 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.111701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258dcb-4b7f-41e5-b8f3-ef7539e6afbd None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.112006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258dcb-4b7f-41e5-b8f3-ef7539e6afbd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.112253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258dcb-4b7f-41e5-b8f3-ef7539e6afbd None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.113614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 213/434] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:53.120577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334343da-d40e-42dc-98d7-f7ba4186f661 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.120868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334343da-d40e-42dc-98d7-f7ba4186f661 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.121183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334343da-d40e-42dc-98d7-f7ba4186f661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.142394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-334343da-d40e-42dc-98d7-f7ba4186f661 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:53.143584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-334343da-d40e-42dc-98d7-f7ba4186f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:53.175824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96a703-da33-44bc-9701-2394ce486c25 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:53.216048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:53.216850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.217374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.217374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.228312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:53.230262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 214/435] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:48:53.233578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:53.241971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:53.242981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:53.243789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 222/436] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:53.250355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334343da-d40e-42dc-98d7-f7ba4186f661 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.255507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.360628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:53.392370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e18a59-3827-4619-8b4a-00cfb0d04bfc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:53.394417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334343da-d40e-42dc-98d7-f7ba4186f661 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:53.439310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:53.439991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.440270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.440542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.441287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:53.441593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:53.443001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:53.445314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:53.446307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.446693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.446978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.453598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 215/437] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:53.458911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.460885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:53.468853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:53.469759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:53.470795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 223/438] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:48:53.478728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.559302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:53.598330 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41084-ca2a-4048-a6b6-89f38fb37ffa None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:53.610627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f57cd0-ec86-4ef9-806e-45e1ffbbe593 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:53.634140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57723e9b-a403-4ec5-9ead-f62d78e145b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:53.634836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57723e9b-a403-4ec5-9ead-f62d78e145b4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.635113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57723e9b-a403-4ec5-9ead-f62d78e145b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.635381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57723e9b-a403-4ec5-9ead-f62d78e145b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.639122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:53.644397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dffaa-dd57-4e2b-9a01-f7dbe39274df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:53.645072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dffaa-dd57-4e2b-9a01-f7dbe39274df None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.645355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dffaa-dd57-4e2b-9a01-f7dbe39274df None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.645631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dffaa-dd57-4e2b-9a01-f7dbe39274df None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.646432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dffaa-dd57-4e2b-9a01-f7dbe39274df None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:53.646744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dffaa-dd57-4e2b-9a01-f7dbe39274df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:53.648129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dffaa-dd57-4e2b-9a01-f7dbe39274df None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:53.656290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 224/439] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:48:53.657515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b469-0fec-453a-9552-895492739404 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.657803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b469-0fec-453a-9552-895492739404 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.658082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b469-0fec-453a-9552-895492739404 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.659328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 225/440] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:53.661782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1b469-0fec-453a-9552-895492739404 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.708928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57723e9b-a403-4ec5-9ead-f62d78e145b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:53.710440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57723e9b-a403-4ec5-9ead-f62d78e145b4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:53.759978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1b469-0fec-453a-9552-895492739404 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:53.781823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:53.793932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:53.794604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.794886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.795157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.805843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 216/441] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:53.810748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f119d-a538-4f73-8e6a-156f73ba2528 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:53.810748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f119d-a538-4f73-8e6a-156f73ba2528 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:53.810748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f119d-a538-4f73-8e6a-156f73ba2528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:53.823928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bb9f119d-a538-4f73-8e6a-156f73ba2528 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:53.825572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bb9f119d-a538-4f73-8e6a-156f73ba2528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:53.856680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:53.861669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:53.863158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:53.897167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 217/442] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:53.897725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f119d-a538-4f73-8e6a-156f73ba2528 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.962298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 226/443] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:48:53.967075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:53.991105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.001819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f119d-a538-4f73-8e6a-156f73ba2528 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.036578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.037379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.037662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.037935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] PATH_INFO: `/v3/projects/8cee784ec8864757a1c8441df24c7f48` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.039186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] RBAC: Authorizing `identity:get_project(project_id=8cee784ec8864757a1c8441df24c7f48)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.040627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.042332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 218/444] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/projects/8cee784ec8864757a1c8441df24c7f48 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.043283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.072425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb72e1a-0345-4127-9fdb-ef2019c77827 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.078535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.105926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.106870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.107146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.107413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.117591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:48:54.125937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:54.127043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 227/445] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:54.127905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.148770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268095-494b-47ca-8364-e42b5eab4338 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.182357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.183223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.183496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.183789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.185512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.188106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.190941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 219/446] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.192130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.214166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.232346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318332e8-5193-4338-a5a8-f1339c1e22b0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.266021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.266906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.267192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.267512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] PATH_INFO: `/v3/groups/9f7a433b708f4cd6869289f81c64305c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.268694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] RBAC: Authorizing `identity:get_group(group_id=9f7a433b708f4cd6869289f81c64305c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.270160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.271796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 228/447] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/groups/9f7a433b708f4cd6869289f81c64305c => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.272534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.301623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c39ec-9ea8-496a-a6a8-63aebdd23e24 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.303113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.338627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.339305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.339594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.339875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.340816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:54.341128 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.342574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.350587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 220/448] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.351383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.376014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd5240-6d36-43b2-afc3-49ffb5c14b78 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.408731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.409600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.409887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.410194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.411387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.412844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.414512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 229/449] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.415275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.433804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.459819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f4b7-b8a0-40c5-a36c-cfa640c98cdb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.491703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.492354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.492636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.492913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.493738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] RBAC: Adding query filter params (group.id=9f7a433b708f4cd6869289f81c64305c, role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=8cee784ec8864757a1c8441df24c7f48) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:54.494048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.495873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.501786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 221/450] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/role_assignments?group.id=9f7a433b708f4cd6869289f81c64305c&scope.project.id=8cee784ec8864757a1c8441df24c7f48&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.502585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.516307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597ba88-591a-4e2d-a451-aeb8f26e9a07 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.547959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.560579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.561153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.561932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.562259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.634351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e010d-0e9c-4d87-b216-5d28861f0044 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.650084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.651622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.671577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.672251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.672537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.672814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.673658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=de38664d376f45f6a446103b7f17e7b3, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:54.674257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.674754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.675657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.694167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 222/451] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=de38664d376f45f6a446103b7f17e7b3 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.794468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 230/452] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:48:54.800303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:54.898381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:54.908121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee45d0-cad6-48ad-8750-0fdba2d6103f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:54.945227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:54.946125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:54.946411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:54.946689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] PATH_INFO: `/v3/projects/3e033f2a03224efcbefc45d2fd80e48d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:54.947902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] RBAC: Authorizing `identity:get_project(project_id=3e033f2a03224efcbefc45d2fd80e48d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:54.949387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:54.951741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 223/453] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/projects/3e033f2a03224efcbefc45d2fd80e48d => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:54.957536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:55.064304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b4e9-ec4a-4f69-a87d-23ba10a679af None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:55.081773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:55.098697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604fe1b-3992-461f-b463-aaa79739f511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:55.099559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604fe1b-3992-461f-b463-aaa79739f511 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:55.099835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604fe1b-3992-461f-b463-aaa79739f511 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:55.100104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604fe1b-3992-461f-b463-aaa79739f511 None admin] PATH_INFO: `/v3/groups/c509138038b74ebd9672698f96402ed1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:55.101266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604fe1b-3992-461f-b463-aaa79739f511 None admin] RBAC: Authorizing `identity:get_group(group_id=c509138038b74ebd9672698f96402ed1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:55.102779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604fe1b-3992-461f-b463-aaa79739f511 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:55.104363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 231/454] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 3 12:48:54 2022] GET /identity/v3/groups/c509138038b74ebd9672698f96402ed1 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:55.110452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:55.215530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d442cfa-4866-45fa-8530-65e1fc93b302 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:55.253630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b840d7-f1a7-4dfc-9630-581aaa787674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:55.254406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b840d7-f1a7-4dfc-9630-581aaa787674 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:55.254683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b840d7-f1a7-4dfc-9630-581aaa787674 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:55.254961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b840d7-f1a7-4dfc-9630-581aaa787674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:55.255798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b840d7-f1a7-4dfc-9630-581aaa787674 None admin] RBAC: Adding query filter params (group.id=c509138038b74ebd9672698f96402ed1, role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=3e033f2a03224efcbefc45d2fd80e48d) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:55.256116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b840d7-f1a7-4dfc-9630-581aaa787674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:55.257607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b840d7-f1a7-4dfc-9630-581aaa787674 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:55.264116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 224/455] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 3 12:48:55 2022] GET /identity/v3/role_assignments?group.id=c509138038b74ebd9672698f96402ed1&scope.project.id=3e033f2a03224efcbefc45d2fd80e48d&role.id=66551becb6cc4504bfbd74555d898a06 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:58.203719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba306da-454c-49f3-8178-ddb62d01552b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.204607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba306da-454c-49f3-8178-ddb62d01552b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.205063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba306da-454c-49f3-8178-ddb62d01552b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.206883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 232/456] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:58.214693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf844-1c8e-488f-a893-845595e7af50 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.214693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf844-1c8e-488f-a893-845595e7af50 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.214693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf844-1c8e-488f-a893-845595e7af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.235004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-73fbf844-1c8e-488f-a893-845595e7af50 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:58.236528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-73fbf844-1c8e-488f-a893-845595e7af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:58.261439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:58.335409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 225/457] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:58.377806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba306da-454c-49f3-8178-ddb62d01552b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:58.535400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba306da-454c-49f3-8178-ddb62d01552b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:58.553901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0ae9-7461-4d95-ab38-d29881a4e3f7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.554561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0ae9-7461-4d95-ab38-d29881a4e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.554938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0ae9-7461-4d95-ab38-d29881a4e3f7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.556885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 226/458] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:58.562835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29bfd7-c835-4e8d-bfdb-58f761e5b2b6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.563384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29bfd7-c835-4e8d-bfdb-58f761e5b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.563942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29bfd7-c835-4e8d-bfdb-58f761e5b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.577670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f67df5-0094-4256-a016-bce5010460fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:58.578564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67df5-0094-4256-a016-bce5010460fb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.578857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67df5-0094-4256-a016-bce5010460fb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.579135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67df5-0094-4256-a016-bce5010460fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.599750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ec29bfd7-c835-4e8d-bfdb-58f761e5b2b6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:58.600958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ec29bfd7-c835-4e8d-bfdb-58f761e5b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:58.602213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f67df5-0094-4256-a016-bce5010460fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:58.603882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f67df5-0094-4256-a016-bce5010460fb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-21f67df5-0094-4256-a016-bce5010460fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:48:58.639784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:58.640796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:58.641662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:48:58.641662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:48:58.641662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:58.641662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:58.641662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 233/459] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:58.651772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f271-f7ab-4066-bdef-18a3e9e7a517 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.652363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f271-f7ab-4066-bdef-18a3e9e7a517 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.652848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f271-f7ab-4066-bdef-18a3e9e7a517 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.654768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 234/460] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:48:58.655705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f271-f7ab-4066-bdef-18a3e9e7a517 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:58.699721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 227/461] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:58.701261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993616a-734b-4144-8aa0-860531d8026e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.701726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993616a-734b-4144-8aa0-860531d8026e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.702178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993616a-734b-4144-8aa0-860531d8026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.708690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:58.733880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2993616a-734b-4144-8aa0-860531d8026e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:58.735146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2993616a-734b-4144-8aa0-860531d8026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:58.799161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f271-f7ab-4066-bdef-18a3e9e7a517 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:58.830287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 228/462] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:58.831493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993616a-734b-4144-8aa0-860531d8026e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:58.861724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:58.862788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:58.863477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:58.863763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:58.864042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:58.864774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:58.865084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:58.866496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:58.880981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 235/463] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:58.882373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:58.988396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993616a-734b-4144-8aa0-860531d8026e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:58.990352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:58.995673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2a086-72ee-4f7b-9146-955b5581a499 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.032659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.033889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.034406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.034881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.039744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.040586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.040871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.041150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.047558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.049369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.054734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.056203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:48:59.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:59.070627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:59.071481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:48:59.071481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:48:59.071481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:59.071481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:59.073409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 229/464] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:59.074575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:48:59.080118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:59.080960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:59.082220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:48:59.082220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:48:59.082220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:59.082220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:59.082220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 236/465] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:59.082496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.159419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:59.196194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e2152-6ba1-4b42-9d34-ce8b86c050ef None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.196612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c4a55-a418-4218-8bbb-f5839704c7ca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.231298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.232148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.232374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.232726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.233348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:59.233660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.235089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.236509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c564-2df5-4d14-acd9-a3002b9bfabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.237187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c564-2df5-4d14-acd9-a3002b9bfabd None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.237471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c564-2df5-4d14-acd9-a3002b9bfabd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.237749 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c564-2df5-4d14-acd9-a3002b9bfabd None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.238515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c564-2df5-4d14-acd9-a3002b9bfabd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.239959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c564-2df5-4d14-acd9-a3002b9bfabd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.253401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 237/466] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:59.253401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.264541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:59.278160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 230/467] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:59 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:59.278160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8266-e62d-4ed4-a4ba-849884557e7a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.278160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8266-e62d-4ed4-a4ba-849884557e7a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.278160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8266-e62d-4ed4-a4ba-849884557e7a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.278779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 231/468] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:59.279776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8266-e62d-4ed4-a4ba-849884557e7a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.387182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb32cf-8300-4a03-b8cf-7d081f0f80ac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.419833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8266-e62d-4ed4-a4ba-849884557e7a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.429207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd05e14-1d8f-4dbd-b249-716316ad8972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.430264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd05e14-1d8f-4dbd-b249-716316ad8972 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.430763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd05e14-1d8f-4dbd-b249-716316ad8972 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.431218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd05e14-1d8f-4dbd-b249-716316ad8972 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.432186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd05e14-1d8f-4dbd-b249-716316ad8972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:48:59.432678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd05e14-1d8f-4dbd-b249-716316ad8972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.434505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd05e14-1d8f-4dbd-b249-716316ad8972 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.448099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 238/469] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:48:59.449982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30e68-518e-442d-9ed5-6d120c48ff6b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.450564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30e68-518e-442d-9ed5-6d120c48ff6b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.451114 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30e68-518e-442d-9ed5-6d120c48ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.451220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:59.469977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.470711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.470995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.471273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.472002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.473472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.473726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fac30e68-518e-442d-9ed5-6d120c48ff6b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:59.475412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fac30e68-518e-442d-9ed5-6d120c48ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:59.500393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 232/470] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:59 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:59.501031 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.566311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:59.577625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 239/471] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:59.586919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce90b6-b667-4e03-bebc-183e36d5fefd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.587115 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce90b6-b667-4e03-bebc-183e36d5fefd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.587362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce90b6-b667-4e03-bebc-183e36d5fefd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.588872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 240/472] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:48:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:48:59.602139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91183a-4ff9-4f80-93a5-3146dabfdfb3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.602139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91183a-4ff9-4f80-93a5-3146dabfdfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.602139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91183a-4ff9-4f80-93a5-3146dabfdfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.623582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fd91183a-4ff9-4f80-93a5-3146dabfdfb3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:48:59.624829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fd91183a-4ff9-4f80-93a5-3146dabfdfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:48:59.659778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43db2-a98d-4547-a615-1707ceeedc91 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.706048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.706789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.707084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.707359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.708085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.709594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.712154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 241/473] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:48:59.713186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91183a-4ff9-4f80-93a5-3146dabfdfb3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.742166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 233/474] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:48:59 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:48:59.744698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.791641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:59.847064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91183a-4ff9-4f80-93a5-3146dabfdfb3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.888331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3b3cb-b86e-4393-8cdb-08faadc33478 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:48:59.890786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:48:59.899646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.901250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.901686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.902124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.917890 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.921381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.935375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:48:59.936127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:48:59.936420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:48:59.936796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:48:59.937470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:48:59.939082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:48:59.946792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:48:59.947732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:48:59.948593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:48:59.948593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:48:59.948593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:48:59.948593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:48:59.948593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 242/475] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:59.951658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.sql.core [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 12:48:59.951658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 12:48:59.951658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [parameters: {'id': '57895f6cf77142228df4bb6221f0df9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 12:48:59.951658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80235) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 12:48:59.954802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application conn.query(q) Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result.read() Jun 03 12:48:59.969272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return ref.to_dict() Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 12:48:59.970332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application next(self.gen) Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application yield resource Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application next(self.gen) Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise self.value Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application session.commit() Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 12:48:59.971236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.session.flush() Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application compat.raise_( Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 12:48:59.972098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 12:48:59.972997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application conn.query(q) Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result.read() Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 12:48:59.973820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [parameters: {'id': '57895f6cf77142228df4bb6221f0df9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:48:59.976335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 12:48:59.978251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:48:59.979108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 234/476] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 3 12:48:59 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:48:59.979108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:00.093730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664539-9254-4036-9ee3-87c3aba05e00 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:00.102635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:00.107327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663fedf-7712-48d4-9a66-c5fbb5e16895 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:00.134213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:00.135704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:00.136804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:00.137439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:00.138399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:00.138915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:00.140859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:00.150811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:00.152686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:00.152811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:00.153066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:00.156788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 243/477] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:00.161944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:00.164751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:00.174074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:00.175043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 12:49:00.175933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:00.179639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 235/478] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:48:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:00.181311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:00.270524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:00.282855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa155-62e0-46b4-9865-cfa5593f1a37 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:00.302893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd09e7-dd1c-4bca-9f4e-609db58583b7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:00.342151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571b87-d78a-48cd-bc09-4d2f96b3f746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:00.342151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571b87-d78a-48cd-bc09-4d2f96b3f746 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:00.342151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571b87-d78a-48cd-bc09-4d2f96b3f746 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:00.342507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571b87-d78a-48cd-bc09-4d2f96b3f746 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:00.343177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571b87-d78a-48cd-bc09-4d2f96b3f746 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:00.344641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571b87-d78a-48cd-bc09-4d2f96b3f746 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:00.368450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781ec09-aa56-4f56-a519-b13c6957c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:00.369141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ec09-aa56-4f56-a519-b13c6957c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:00.369677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ec09-aa56-4f56-a519-b13c6957c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:00.370180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ec09-aa56-4f56-a519-b13c6957c1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:00.372309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781ec09-aa56-4f56-a519-b13c6957c1a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:00.372859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781ec09-aa56-4f56-a519-b13c6957c1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:00.374944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781ec09-aa56-4f56-a519-b13c6957c1a1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:00.384473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 244/479] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:49:00 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:00.391825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 236/480] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:02.155750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66aa6b-3a9f-4ff2-8e80-459627d682d9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.156306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66aa6b-3a9f-4ff2-8e80-459627d682d9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.156306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66aa6b-3a9f-4ff2-8e80-459627d682d9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.157904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 245/481] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:02.163473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1230d-8bc4-4be8-9758-54e6635157e9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.163875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1230d-8bc4-4be8-9758-54e6635157e9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.164043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1230d-8bc4-4be8-9758-54e6635157e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.181715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fed1230d-8bc4-4be8-9758-54e6635157e9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:02.187040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fed1230d-8bc4-4be8-9758-54e6635157e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:02.206975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:02.272847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 237/482] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:02.318495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66aa6b-3a9f-4ff2-8e80-459627d682d9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:02.471299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:02.476023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66aa6b-3a9f-4ff2-8e80-459627d682d9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:02.501158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14930-5c2d-40a3-abb4-0b92ba0b165c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.501735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14930-5c2d-40a3-abb4-0b92ba0b165c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.502214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14930-5c2d-40a3-abb4-0b92ba0b165c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.504135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 238/483] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:02.511658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244434-68f5-4bda-897f-76e7caa52e33 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.512259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244434-68f5-4bda-897f-76e7caa52e33 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.512740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244434-68f5-4bda-897f-76e7caa52e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.523243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:02.524858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.526991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.528357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.555799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1a244434-68f5-4bda-897f-76e7caa52e33 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:02.558446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1a244434-68f5-4bda-897f-76e7caa52e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:02.564123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:02.572303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:02.573171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:02.573979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:02.576717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 246/484] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:02.587361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:02.700925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 239/485] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:02.724855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a244434-68f5-4bda-897f-76e7caa52e33 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:02.777459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576525e1-b215-4268-bd97-8b45fe377d78 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:02.839883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc708-53f6-4674-8b61-7c665450422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:02.841120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc708-53f6-4674-8b61-7c665450422e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.841599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc708-53f6-4674-8b61-7c665450422e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.841885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc708-53f6-4674-8b61-7c665450422e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.842960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc708-53f6-4674-8b61-7c665450422e None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:02.843276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc708-53f6-4674-8b61-7c665450422e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:02.844842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc708-53f6-4674-8b61-7c665450422e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:02.856123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 247/486] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:02.857083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:02.857919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de055fa-88e5-4c7c-b1c9-aae25fa0fef1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.857919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de055fa-88e5-4c7c-b1c9-aae25fa0fef1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.862261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de055fa-88e5-4c7c-b1c9-aae25fa0fef1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.864034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 248/487] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:02.865945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de055fa-88e5-4c7c-b1c9-aae25fa0fef1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:02.893728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:02.896900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a244434-68f5-4bda-897f-76e7caa52e33 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:02.950804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc10a7-6059-4ca7-a4e1-30800e835cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:02.951623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc10a7-6059-4ca7-a4e1-30800e835cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.952167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc10a7-6059-4ca7-a4e1-30800e835cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.952447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc10a7-6059-4ca7-a4e1-30800e835cd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.965674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc10a7-6059-4ca7-a4e1-30800e835cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a8cc10a7-6059-4ca7-a4e1-30800e835cd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:02.975572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:02.976469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:02.977304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 240/488] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:02.978480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327e696-9032-4dc6-9810-ea63b3ce8626 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:02.978644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327e696-9032-4dc6-9810-ea63b3ce8626 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:02.978902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327e696-9032-4dc6-9810-ea63b3ce8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:02.991574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de055fa-88e5-4c7c-b1c9-aae25fa0fef1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.001241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0327e696-9032-4dc6-9810-ea63b3ce8626 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:03.002472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0327e696-9032-4dc6-9810-ea63b3ce8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:03.037039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.037859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.038174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.038445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.052400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:03.054469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:03.078878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:03.079785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:03.080660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:03.080660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:03.080660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:03.080660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:03.082185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 249/489] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:03.083216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.089008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 241/490] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:03.090259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327e696-9032-4dc6-9810-ea63b3ce8626 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.168619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:03.178500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:03.211724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e665e1-70fd-43e3-a096-e6f523703af9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.215743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327e696-9032-4dc6-9810-ea63b3ce8626 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.248664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.249263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.249552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.249833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.250621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:03.250933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:03.252325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:03.257629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5274980-6b37-4c7a-941c-d7c24ded93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.258355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5274980-6b37-4c7a-941c-d7c24ded93a5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.258639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5274980-6b37-4c7a-941c-d7c24ded93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.258918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5274980-6b37-4c7a-941c-d7c24ded93a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.259647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5274980-6b37-4c7a-941c-d7c24ded93a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:03.259957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5274980-6b37-4c7a-941c-d7c24ded93a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:03.261157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 250/491] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:03.261333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5274980-6b37-4c7a-941c-d7c24ded93a5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:03.261760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.285148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 242/492] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:03.286371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667041-681f-42ba-83fc-e434207078f9 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.286663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667041-681f-42ba-83fc-e434207078f9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.286944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667041-681f-42ba-83fc-e434207078f9 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.288235 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 243/493] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:03.290401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667041-681f-42ba-83fc-e434207078f9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.364530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18783f55-2c6c-4f3e-b4df-f6ba2f74a862 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.392324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667041-681f-42ba-83fc-e434207078f9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.399721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.400534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.400822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.401104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.403737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:03.413090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:03.420988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:03.421931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:03.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:03.423796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:03.423876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 251/494] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:03.423876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.432691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf33f6-915b-41f7-aea3-6363c1b67058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.433509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf33f6-915b-41f7-aea3-6363c1b67058 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.433790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf33f6-915b-41f7-aea3-6363c1b67058 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.434094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf33f6-915b-41f7-aea3-6363c1b67058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.445179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf33f6-915b-41f7-aea3-6363c1b67058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:03.446671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf33f6-915b-41f7-aea3-6363c1b67058 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9baf33f6-915b-41f7-aea3-6363c1b67058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:03.464849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:03.465908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:03.466886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:03.466886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:03.466886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:03.466886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:03.466886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 244/495] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:03.467535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cbe27-a77d-4f61-adf1-e64cc97b3091 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.467826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cbe27-a77d-4f61-adf1-e64cc97b3091 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.468106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cbe27-a77d-4f61-adf1-e64cc97b3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.484871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d90cbe27-a77d-4f61-adf1-e64cc97b3091 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:03.486073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d90cbe27-a77d-4f61-adf1-e64cc97b3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:03.530788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d89cb-3104-412c-a82b-5466301f3831 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.557013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 245/496] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:03.558405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1687-cc3e-45a1-9b53-923c8abf8f80 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.558680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1687-cc3e-45a1-9b53-923c8abf8f80 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.559093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1687-cc3e-45a1-9b53-923c8abf8f80 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.560591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 246/497] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:03.561125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf1687-cc3e-45a1-9b53-923c8abf8f80 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.575464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.576304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.576582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.576859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.585334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:03.586831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:03.602875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:03.603974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 252/498] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:03.605141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.661486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:03.664085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf1687-cc3e-45a1-9b53-923c8abf8f80 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.677960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:03.699391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8c3a7-b690-4f7b-8d8c-b246c7d8f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.700204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c3a7-b690-4f7b-8d8c-b246c7d8f484 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.700481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c3a7-b690-4f7b-8d8c-b246c7d8f484 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.700842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c3a7-b690-4f7b-8d8c-b246c7d8f484 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.706788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee29e4-5f64-453d-b9f9-01dfb87d9b7b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.707776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8c3a7-b690-4f7b-8d8c-b246c7d8f484 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:03.708252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8c3a7-b690-4f7b-8d8c-b246c7d8f484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:03.710260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8c3a7-b690-4f7b-8d8c-b246c7d8f484 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:03.719704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 247/499] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:03.721030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839aaaf-02d6-4fe9-874e-750508ac18ba None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.721382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839aaaf-02d6-4fe9-874e-750508ac18ba None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.721675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839aaaf-02d6-4fe9-874e-750508ac18ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.739297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0839aaaf-02d6-4fe9-874e-750508ac18ba None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:03.740510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0839aaaf-02d6-4fe9-874e-750508ac18ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:03.740966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.741635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.741921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.742226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.742953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:03.743267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:03.744632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:03.758049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 253/500] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:03.758891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.866298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d666-63fa-481d-9016-34ffe456c753 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:03.882723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:03.904916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:03.905732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:03.906025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:03.906321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:03.920843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:03.930148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:03.931162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 254/501] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:03.932169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:03.949288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 248/502] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:03.951070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839aaaf-02d6-4fe9-874e-750508ac18ba None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.055140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f6da-1768-4c3f-ae75-e6d5e180d200 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.064803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839aaaf-02d6-4fe9-874e-750508ac18ba None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.067902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.089912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.090637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.090920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.091195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.092024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:04.092332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.093768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.098767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.099561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.099845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.100118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.110366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.111827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:04.129688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:04.130593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:04.131435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:04.131435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:04.131435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:04.131435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:04.131435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 249/503] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:04.131705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 255/504] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:49:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:04.131775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.132606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.169169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.232263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883257df-6997-44d1-aedf-eb8f1365128e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.238642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81016-a3a5-48a5-808d-2c0254b9ebf7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.265631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.266525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.266813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.267094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.272630 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.273293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.273625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.273903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.274307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.274695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:04.275003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.275767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.276359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.284613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 256/505] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:04.285438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:04.291206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:04.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:04.293004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 250/506] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:04.293613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.312655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.379771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.387790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb2c52-ee1b-4726-b56c-7d5b5aa16aac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.395895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf2cb0-0aca-4fa8-8d46-5b7e1e6216c9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.420131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.420927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.421205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.421511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.428629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.429291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.429578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.429862 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.430632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:04.430943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.431863 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.432349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.433297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.444428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 251/507] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:04.445019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:04.451030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:04.452074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:04.453048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:04.453048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:04.453048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:04.453048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:04.453048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 257/508] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:04.453550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.524537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.552694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce07dc7-81e0-4505-9fa4-571a489f1b2e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.555998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd75a7f-d0e1-4cae-891b-a8e230091271 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.586574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.587213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.587496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.587765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.588680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.589480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.589764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.590042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.600544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.602218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.608448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:04.619945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:04.621202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:04.622083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:04.622083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:04.622083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:04.622083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:04.622083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 258/509] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:04.622590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.659880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.661264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.728312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf70ab-f6e9-4919-aeff-0410d169cd12 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.736884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.763387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 252/510] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:04.764324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.765684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.766398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.766788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.767209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.768521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:04.769296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.771266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.789941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 259/511] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:04.790790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.846051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:04.866433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824124-3cb2-46a4-8bdd-ff893310248c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.890001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06f9c-4f1b-4cd7-953d-2e88eb30aa7b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:04.902205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.903041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.903322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.903601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.910664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.912071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.922884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:04.923554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:04.923839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:04.924118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:04.924843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:04.925155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:04.926567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:04.926660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:04.927506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 253/512] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:04.932424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.938581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 260/513] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:04.939421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:04.963953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.031366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41483786-d1a7-4af7-8461-9ad97f25ec60 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.041668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6a892-2deb-4b34-a655-83e961fee103 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.057608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.065773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.066549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.066927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.067218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.067928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:05.068237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.069632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.075533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.076333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.076609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.076878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.080863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 254/514] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:05.081636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.087836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.089293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:05.107139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:05.108181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:05.109213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:05.109213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:05.109213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:05.109213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:05.109622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 261/515] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:05.110480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.176057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.182279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156813-d9b3-4224-872f-156900ea1610 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.208037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f07320-669a-4361-b76b-1eadd4949a06 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.217121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.217892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.218334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.218711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.240231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.240937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.241177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.241459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.242335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:05.242655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.244103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.261490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 262/516] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:05.262495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.289182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.292887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.294505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.360121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a583-f972-48ed-91d3-b11c8b4ac9dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.385091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.392362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 255/517] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:05.393170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.393327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.393953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.394323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.394657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.395412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.397088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.418734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 263/518] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:49:05 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:05.419552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.510994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18f49b-1f0b-4780-a32c-4edd26db0be1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.511746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.536744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7454c-7a61-49be-ae1e-8adc1c78ff82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.550885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.551793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.552183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.552536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.560915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.562419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.577573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.578378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.578734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:05.578975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:05.580020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 12:49:05.586522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:05.587164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.587252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 256/519] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:05.587342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:05.587342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.587489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.587570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.600903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 264/520] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:05.602264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.661142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.711183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef35f4-fa11-4d17-990f-f9b19b6b5c1b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.716300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9b360-fe50-4da8-91b7-69392c70e878 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.751597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.752248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.752608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.752886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.753118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.753932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.754250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.754531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.765782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.767263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.769219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:05.787979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:05.788870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:05.789875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:05.789875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:05.789875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:05.789875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:05.789875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 265/521] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:05.790174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.834389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.835849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.893227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:05.899486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199c397-de1c-435c-b02c-ce2b480e3a3e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:05.934585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:05.935397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:05.935687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:05.936156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:05.936862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:05.937177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:05.938652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:05.944566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 257/522] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:05.944566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:05.967535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 266/523] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:05.967535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.021730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.055510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3edb-6934-4983-aa90-ba37ffc2ace1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.073628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3e97-752e-4b02-868e-0facc09dac61 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.094735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.095541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.095832 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.096102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.102871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.104338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.110674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.111353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.111642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.111923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.112652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:06.112966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.114372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:06.119730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 258/524] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:06.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.138095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 267/525] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:06.138095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.142791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.226387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb0e9c-8ad2-4cc2-ad6b-74cbabdaae3a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.245255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88170cc7-afb6-42f6-be65-42cf1e30d9d1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.261308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.261493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.262457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.262720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.263039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.275010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.276408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.286397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.287060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.287348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.287630 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:06.294324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:06.295602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:06.296446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:06.296446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:06.296446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:06.296446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:06.298466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 259/526] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:06.299910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.361711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.363459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.369366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.404536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ad17-bb3e-46b0-9906-c9712ff89e60 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.439247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.439912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.440196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.440475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.441263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:06.441901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.443051 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.461497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 260/527] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:06.462245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.472957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 268/528] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:06.473884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.488239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.584459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70eb6-f284-4159-94b2-ce942c5f82ef None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.584992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055866-c895-4010-913a-82e4bc3bf97c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.614517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.626187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.626187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.626187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.626187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.626592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.626691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:06.626691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.626816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.626816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.626816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.627010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.631969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.633421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.637866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 269/529] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:06.642946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:06.648149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:06.649017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:06.649881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:06.654379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 261/530] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:06.655175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.717146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.751869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c953f5e-8fbe-4fcc-9342-6d56d54800f7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.761245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce1340-c90f-4dae-971c-2811355ffd86 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.792264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.793123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.793605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.794028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.794203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.795004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.795291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.795488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=8948febd509a4edca08572764acfdcba) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:06.795595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:06.796028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.797798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.804723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 270/531] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/role_assignments?user.id=8948febd509a4edca08572764acfdcba&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:06.806039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.806175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:06.807612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:06.829309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:06.830290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:06.831157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:06.831157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:06.831157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:06.831157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:06.835409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 262/532] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:06.836275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:06.894031 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:06.955912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0e9de-4dce-42f0-8305-58cf1f9bc92f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.964949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a63b-9a78-4d21-9658-c3cc23741137 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:06.997418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:06.998689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:06.999188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:06.999677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.003161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:07.003304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.004138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.004268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.004477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.005278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:07.005591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.007196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.010583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.012495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.021604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 263/533] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:07.022500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:07.030202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:07.031104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:07.031936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 271/534] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:07.032972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.128195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:07.131897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160285-53ed-4ca1-8d01-bb56a731f986 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:07.144207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63e430-d2d3-4f09-81e6-e859888d472a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:07.168069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.169165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.169604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.169956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.170804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:07.171179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.172635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.180555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.181225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.181599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.181894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.182770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=58ea8ab7aaf7415ea86a0975dfe54a52) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:07.183085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.184618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.189868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 264/535] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:07.190866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.191421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 272/536] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/role_assignments?user.id=58ea8ab7aaf7415ea86a0975dfe54a52&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:07.192245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.261260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:07.310345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196691-2697-4f8a-852b-0c96a4e45064 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:07.351424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.352253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.352536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.352813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.361243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.362775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.366398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75401a0-7bc6-4e60-972e-af060ff9886d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:07.379047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:07.379937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:07.380810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 273/537] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:07.386506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.455988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.456682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.456970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.457251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.458065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:07.458417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.459908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.488553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 265/538] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:07.496806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.529176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:07.556138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f18bc-fab0-43c5-9fab-e0172c300faf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:07.594476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:07.622836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.623512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.623798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.624081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.624876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:07.625187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.626680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.659659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 274/539] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:07.666173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.682307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a693-1673-437c-a0ee-c3c57c0b2a5b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:07.742787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298020b7-243b-4a72-9e53-4392da52c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.743458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298020b7-243b-4a72-9e53-4392da52c123 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.743740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298020b7-243b-4a72-9e53-4392da52c123 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.744017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298020b7-243b-4a72-9e53-4392da52c123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.744853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298020b7-243b-4a72-9e53-4392da52c123 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=30ea8e8f73ad4862a22ca7ce2b461740) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:07.745164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298020b7-243b-4a72-9e53-4392da52c123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.747338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298020b7-243b-4a72-9e53-4392da52c123 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.753469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 266/540] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/role_assignments?user.id=30ea8e8f73ad4862a22ca7ce2b461740&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:07.754861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5116e-313e-4e97-90cd-ab80975edc57 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.755145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5116e-313e-4e97-90cd-ab80975edc57 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.755419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5116e-313e-4e97-90cd-ab80975edc57 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.761425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 267/541] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:07.763043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bc781-ebaa-4805-91d0-04dfd0287227 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.763331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bc781-ebaa-4805-91d0-04dfd0287227 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.763615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bc781-ebaa-4805-91d0-04dfd0287227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.781140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fa2bc781-ebaa-4805-91d0-04dfd0287227 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:07.782427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fa2bc781-ebaa-4805-91d0-04dfd0287227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:07.826385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ade82-4240-4d62-a581-57314ce0818f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:07.874508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 268/542] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:07.892091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:07.892787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:07.893076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:07.893341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:07.894215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=2fa3a98382cd4b04bb384bbc2ab3a598) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:07.894530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:07.896100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:07.906069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 275/543] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/role_assignments?user.id=2fa3a98382cd4b04bb384bbc2ab3a598&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:07.918809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bc781-ebaa-4805-91d0-04dfd0287227 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:07.937077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:08.038564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bc781-ebaa-4805-91d0-04dfd0287227 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:08.078102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:08.082320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:08.082601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:08.082875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:08.096879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:08.105219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:08.107578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:08.109564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 269/544] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:08.119559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:08.179838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:08.238065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99952c06-cc85-4c44-99e3-5a4b411a1f15 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:08.275383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:08.276170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:08.276523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:08.276813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:08.277574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:08.277958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:08.279408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:08.288909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 276/545] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:08.294519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:08.412538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:08.442271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86659cd-d4c0-412f-b885-195635d5ec3d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:08.492484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:08.493294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:08.493575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:08.493847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:08.505990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:08.511104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:08.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:08.544322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:08.545607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:08.545607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:08.545607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:08.545607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:08.545607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 270/546] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:08.550428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:08.701607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b69820-0576-46c9-8bec-a55130e8c049 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:08.712993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:08.752199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:08.752878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:08.753161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:08.753435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:08.754186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:08.754493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:08.755889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:08.771895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 277/547] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:08.777125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:08.899026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095de089-383d-479f-a1a1-1e4b4f56d4be None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:08.933007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:08.944456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:08.945465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:08.945948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:08.946485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:08.954607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:08.956012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:08.976879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:08.979789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:08.982239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 271/548] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:08.986010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:09.086073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e3ac-a694-4291-92b8-fa3a83870cc2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:09.133547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e5b99-71aa-4345-a327-bfb3ed77dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:09.134264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e5b99-71aa-4345-a327-bfb3ed77dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:09.134558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e5b99-71aa-4345-a327-bfb3ed77dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:09.134829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e5b99-71aa-4345-a327-bfb3ed77dfb5 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:09.135677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e5b99-71aa-4345-a327-bfb3ed77dfb5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:09.135987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e5b99-71aa-4345-a327-bfb3ed77dfb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:09.137594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e5b99-71aa-4345-a327-bfb3ed77dfb5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:09.162525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 278/549] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 3 12:49:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:09.168873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:09.291142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804cd0-9e23-433b-9924-f4bc157480af None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:09.329590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:09.330280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:09.330569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:09.330849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:09.398535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:09.413064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:09.414575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:09.499081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d93d85-6caa-436d-b0cf-293f811c8fdb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:09.499741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d93d85-6caa-436d-b0cf-293f811c8fdb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:09.499741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d93d85-6caa-436d-b0cf-293f811c8fdb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:09.501275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 279/550] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:49:09.506209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80964-35f3-480a-bec7-976eb18d04a7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:09.506507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80964-35f3-480a-bec7-976eb18d04a7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:09.506794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80964-35f3-480a-bec7-976eb18d04a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:09.523513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-52f80964-35f3-480a-bec7-976eb18d04a7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:09.524726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-52f80964-35f3-480a-bec7-976eb18d04a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:09.547604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 272/551] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:09.555480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:09.571340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:09.669980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:09.686924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612f1f9-25f4-40d3-9435-fe2dd31d4246 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:09.712415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 280/552] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:49:09.731166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:09.732214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:09.732562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:09.732853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:09.738574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80964-35f3-480a-bec7-976eb18d04a7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:09.752241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:09.754093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:09.775334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:09.776373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:09.777644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:09.777644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:09.777644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:09.777644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:09.777644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 273/553] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:09.782412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:09.930160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80964-35f3-480a-bec7-976eb18d04a7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:09.939500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aca31-d319-4161-a3b3-d769db50e867 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:09.979073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a23ebc-d7a9-4f99-8b64-96e7dfbfdd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:09.979737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a23ebc-d7a9-4f99-8b64-96e7dfbfdd01 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:09.980016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a23ebc-d7a9-4f99-8b64-96e7dfbfdd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:09.980288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a23ebc-d7a9-4f99-8b64-96e7dfbfdd01 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:09.981042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a23ebc-d7a9-4f99-8b64-96e7dfbfdd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:09.981351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a23ebc-d7a9-4f99-8b64-96e7dfbfdd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:09.982771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a23ebc-d7a9-4f99-8b64-96e7dfbfdd01 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:09.993784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.002530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c9fe1-b36e-4429-96aa-38c3da87f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.003356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9fe1-b36e-4429-96aa-38c3da87f202 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.003633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9fe1-b36e-4429-96aa-38c3da87f202 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.003905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9fe1-b36e-4429-96aa-38c3da87f202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.006915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 274/554] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:10.008264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc1e1-c3ed-4e61-8285-5f79094990de None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.008548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc1e1-c3ed-4e61-8285-5f79094990de None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.008824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc1e1-c3ed-4e61-8285-5f79094990de None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.014572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 275/555] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:10.016025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc1e1-c3ed-4e61-8285-5f79094990de None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.023706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c9fe1-b36e-4429-96aa-38c3da87f202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-968c9fe1-b36e-4429-96aa-38c3da87f202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:10.033847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:10.034819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:10.035633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:10.038190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 281/556] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:10.039700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b133e-b4f2-49c4-98ba-347c13d5d6be None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.041377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b133e-b4f2-49c4-98ba-347c13d5d6be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.042774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b133e-b4f2-49c4-98ba-347c13d5d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.066229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-695b133e-b4f2-49c4-98ba-347c13d5d6be None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:10.067603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-695b133e-b4f2-49c4-98ba-347c13d5d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:10.081886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.141197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc1e1-c3ed-4e61-8285-5f79094990de None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.157977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 282/557] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:10.159316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b133e-b4f2-49c4-98ba-347c13d5d6be None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.209025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.210246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.210758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.211293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.219644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:10.221562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:10.237514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:10.238970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:10.239856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:10.242476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 276/558] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:10.248480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.293725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b133e-b4f2-49c4-98ba-347c13d5d6be None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.313765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.341663 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.342384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.342674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.342953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.343704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:10.344175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:10.345922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:10.358197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 283/559] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:10.359396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.365249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525f00-cf4b-4f22-b002-c4c5ef884ff6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.373048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.405234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.406582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.407088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.407560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.419179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:10.428556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:10.429575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:10.438317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:10.447545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 277/560] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:10.447545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.479327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59809df3-8903-4ab8-b49f-099cfcad78ff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.520092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.520758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.521033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.521315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.522128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:10.522443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:10.523906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:10.536233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 284/561] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:10.539604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.581998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffebd0-52c8-42d9-8342-8406e7ce7f85 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.601327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.613277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.622330 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622521-cf85-4417-a468-98fffa6703cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.623234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622521-cf85-4417-a468-98fffa6703cf None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.623528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622521-cf85-4417-a468-98fffa6703cf None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.623810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622521-cf85-4417-a468-98fffa6703cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.635313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4622521-cf85-4417-a468-98fffa6703cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:10.636786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4622521-cf85-4417-a468-98fffa6703cf None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:10.649789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687b04-75ff-4092-bc26-4a3aba99f9af None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d4622521-cf85-4417-a468-98fffa6703cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:10.655436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:10.656384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:10.657338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:10.657338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:10.657338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:10.657338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:10.661292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 278/562] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:10.662711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a950d-5314-414c-a078-00abd024536b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.663004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a950d-5314-414c-a078-00abd024536b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.663286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a950d-5314-414c-a078-00abd024536b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.666243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 279/563] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:10.666243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a950d-5314-414c-a078-00abd024536b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.691670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.692726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.693159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.693441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.694290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:10.694603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:10.695996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:10.708755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 285/564] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:10.708755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.774768 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a950d-5314-414c-a078-00abd024536b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.810059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b472f-0802-409e-b159-81f815449e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.810803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b472f-0802-409e-b159-81f815449e02 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.811040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b472f-0802-409e-b159-81f815449e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.811318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b472f-0802-409e-b159-81f815449e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.812150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b472f-0802-409e-b159-81f815449e02 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=770bb4d411374e3daddba2cdf48c3c0a) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:10.812465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b472f-0802-409e-b159-81f815449e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:10.813913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b472f-0802-409e-b159-81f815449e02 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:10.819311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e72172-3f74-4998-b65d-549f828825e1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:10.819815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 280/565] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/role_assignments?user.id=770bb4d411374e3daddba2cdf48c3c0a&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:10.827786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0baf6-6bce-48fc-a666-2ebb7877d801 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.828460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0baf6-6bce-48fc-a666-2ebb7877d801 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.828942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0baf6-6bce-48fc-a666-2ebb7877d801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.851398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b0c0baf6-6bce-48fc-a666-2ebb7877d801 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:10.853804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b0c0baf6-6bce-48fc-a666-2ebb7877d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:10.866272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.886173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:10.886884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.887174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.887640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.888541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:10.889530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:10.891058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:10.897535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:10.909566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 286/566] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:10.909566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:10.950632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 281/567] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:10.952353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3d6ea-bc3d-45cb-8c84-a4f054bcfa07 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:10.952781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3d6ea-bc3d-45cb-8c84-a4f054bcfa07 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:10.953219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3d6ea-bc3d-45cb-8c84-a4f054bcfa07 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:10.954721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 282/568] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:10.955568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3d6ea-bc3d-45cb-8c84-a4f054bcfa07 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.032635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac31ed-86f3-4d5f-bc39-8d94f8db1865 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.069711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5231f-d266-45b5-9627-c3050391a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.070553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5231f-d266-45b5-9627-c3050391a822 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.070837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5231f-d266-45b5-9627-c3050391a822 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.071113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5231f-d266-45b5-9627-c3050391a822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.076617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3d6ea-bc3d-45cb-8c84-a4f054bcfa07 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.082776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5231f-d266-45b5-9627-c3050391a822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.084655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5231f-d266-45b5-9627-c3050391a822 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-aac5231f-d266-45b5-9627-c3050391a822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:11.102793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:11.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:11.104613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:11.104613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:11.104613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:11.104613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:11.104613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 287/569] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:11.105345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65f13-e275-4220-91ae-85dbf9790604 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.105506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65f13-e275-4220-91ae-85dbf9790604 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.105768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65f13-e275-4220-91ae-85dbf9790604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.119194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.120586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.121423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.121922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.124238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-92b65f13-e275-4220-91ae-85dbf9790604 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:11.125460 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92b65f13-e275-4220-91ae-85dbf9790604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:11.131195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.132868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:11.153146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:11.154283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:11.155225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:11.173177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 283/570] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:49:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:11.173177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.181303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:11.200565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:11.230133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 288/571] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:11.230133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65f13-e275-4220-91ae-85dbf9790604 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.283431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9e377-68c4-4529-824b-272fffeafbda None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.322427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.323299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.323584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.323859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.334689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:11.342540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:11.343455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:11.349574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:11.350260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65f13-e275-4220-91ae-85dbf9790604 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.350339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 284/572] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:11.350339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.388679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.389354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.389641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.390364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.391096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:11.391414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.393495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.409236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 289/573] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:11.409236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.442127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:11.445616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:11.463735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc6c97-eae3-4baa-ae16-aaed11042f08 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.500176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.500850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.501135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.501413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.502286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:11.502602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.504048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.517294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb24a1-ad9d-4a27-9108-45e9a2250054 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.542797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 285/574] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:11.543321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.563772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.565182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.565467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.565741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.576776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:11.584481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:11.585423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:11.586299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 290/575] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:11.586992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.660223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcaf6-25d7-40c5-9e42-cd28cf182a9b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.679872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:11.689961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73279-2c82-42c1-a274-b0fa253018dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.699844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.700826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.701384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.701672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.702459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:11.702933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.704961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.719900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 286/576] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:11.719900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.723320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.724091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.724375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.724648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.724876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:11.733920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.735727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:11.750911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:11.751886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 291/577] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:11.752822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.828404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c91d4-05dc-4c35-a204-61e5f0c61d18 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.863464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.864383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.864667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.864939 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.865772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015f250-547d-49f6-8950-2a4f8c92968f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:11.876457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.877949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:11.895602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:11.896544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:11.897467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:11.897467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:11.897467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:11.897467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:11.897467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 287/578] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:11.897738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.912093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13412-a413-41c1-9399-719cda895518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:11.913314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13412-a413-41c1-9399-719cda895518 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:11.914273 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13412-a413-41c1-9399-719cda895518 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:11.914865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13412-a413-41c1-9399-719cda895518 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:11.915929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13412-a413-41c1-9399-719cda895518 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:11.916669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13412-a413-41c1-9399-719cda895518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:11.918959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13412-a413-41c1-9399-719cda895518 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:11.938227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 292/579] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:11.938227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13412-a413-41c1-9399-719cda895518 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:11.953434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:11.958588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.008033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8764fb3-a763-46ee-b0be-f0bcb034725c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.045868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.046693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.046970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.047246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.050345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13412-a413-41c1-9399-719cda895518 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.058747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.060299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:12.078983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:12.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:12.080840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:12.080840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:12.080840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:12.080840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:12.080840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 288/580] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:12.081723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.092383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.093040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.093376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.093624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.094485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:12.094799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.096253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.115084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 293/581] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 3 12:49:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:12.120511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.190233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c498-17a9-49f9-8fc5-749b7f304231 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.191703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.202305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.222509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165e1bc-c643-4d69-9e4e-79b4f42d4534 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.234073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.234866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.235138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.235347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.236065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:12.236450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.237741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.256297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 289/582] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:12.256297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.262853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.264173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.264528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.264868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.275728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.277297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:12.295688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:12.296592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:12.297538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:12.297538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:12.297538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:12.297538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:12.297538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 294/583] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:12.297813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.362677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb66f90-b2d1-49b7-a4b8-7161f004caf0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.396989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.397658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.397945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.398258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.398992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:12.399297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.400688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.407815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d036b6-74da-4169-858f-fcde1b6b2463 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.412033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 290/584] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:12.416916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.433495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.445143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.447217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.448057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.448342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.448808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.459946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.461592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:12.479180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:12.480116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:12.480993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:12.480993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:12.480993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:12.480993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:12.480993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 295/585] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:12.481870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.531362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979bef-c527-4992-b9d7-845601c64817 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.568040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.568839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.569117 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.569384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.576612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.578066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.591758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f927-1cd8-460c-b7a1-e8475f2779c2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:12.592316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:12.593210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:12.594125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 291/586] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:12.595179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.632099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.632781 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.633137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.633508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.634266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:12.634581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.635998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.648913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 296/587] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:12.649538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.684988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.690756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.703838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d25e-9936-4fc1-85f6-ef0cd28278a6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.740585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.741413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.741698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.741976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.750806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.752291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.767013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324b2b-7148-4fa0-bc93-1d60193ff2b9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:12.768199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:12.769133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:12.770083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 292/588] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:12.770724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.809961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.810686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.810973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.811250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.812042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:12.812357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.813752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.826640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 297/589] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:12.827455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.880166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e88d4-7412-44c3-8cd7-e952a2c69eb0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.915463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.916192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.916475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.916751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.917536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:12.917843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.919490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:12.928547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.932762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 293/590] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:12.933665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:12.942994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a14d0-9c74-4371-9e69-bdf5d1a85669 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:12.950734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:12.977576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:12.978421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:12.978708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:12.978985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:12.987162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:12.988758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:13.005271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:13.006262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:13.007190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 298/591] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:13.007772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.052733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f097644-ed47-4922-9b46-3d4806217d02 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.086553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.087212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.087490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.087761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.088595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:13.088902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.090350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.107267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 294/592] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 3 12:49:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:13.108028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.114992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0d78f-6ae0-4e47-a979-137b4eb7b335 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.148422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.149210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.149499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.149780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.156591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.158042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.170611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:13.172086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:13.173142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:13.174102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 299/593] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:13.174638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.189818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:13.211592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363902-0046-4247-9db7-8e108efb655b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.245679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebdf58-4269-4370-946d-5daab014a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.246991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebdf58-4269-4370-946d-5daab014a43b None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.247274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebdf58-4269-4370-946d-5daab014a43b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.247554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebdf58-4269-4370-946d-5daab014a43b None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/8948febd509a4edca08572764acfdcba/roles/664cd40cb8424f818c65b66e06e19363` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.261843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebdf58-4269-4370-946d-5daab014a43b None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=8948febd509a4edca08572764acfdcba, role_id=664cd40cb8424f818c65b66e06e19363)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.263392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebdf58-4269-4370-946d-5daab014a43b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.276234 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7055d6-fdd8-4f6b-b033-4f3ea642eb3c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.277071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 295/594] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:13 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/8948febd509a4edca08572764acfdcba/roles/664cd40cb8424f818c65b66e06e19363 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:13.278439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6ac28-3b59-4bdc-be71-c2f6750caf00 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.278895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6ac28-3b59-4bdc-be71-c2f6750caf00 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.279871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6ac28-3b59-4bdc-be71-c2f6750caf00 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.282241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 296/595] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:13.282241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6ac28-3b59-4bdc-be71-c2f6750caf00 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.317328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.318161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.318543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.318895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.319823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:13.320202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.321788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.347059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 300/596] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:13.347059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.407347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6ac28-3b59-4bdc-be71-c2f6750caf00 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.425574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:13.429069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:13.451840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463f644-0e0d-4c26-9285-3eaf17c133ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.452654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f644-0e0d-4c26-9285-3eaf17c133ab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.452934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f644-0e0d-4c26-9285-3eaf17c133ab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.453221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f644-0e0d-4c26-9285-3eaf17c133ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.464593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463f644-0e0d-4c26-9285-3eaf17c133ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.464949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80fdbe-932f-4e61-a286-2de5f26d5005 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.466137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463f644-0e0d-4c26-9285-3eaf17c133ab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3463f644-0e0d-4c26-9285-3eaf17c133ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:13.488119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:13.489111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:13.490017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:13.490017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:13.490017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:13.490017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:13.494056 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 297/597] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:13.495475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449402da-d708-4e1e-9741-6eedda1989c2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.495775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449402da-d708-4e1e-9741-6eedda1989c2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.496376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449402da-d708-4e1e-9741-6eedda1989c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.509154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.510302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.510691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.511066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.512019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:13.512503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.513575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-449402da-d708-4e1e-9741-6eedda1989c2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:13.514446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.514891 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-449402da-d708-4e1e-9741-6eedda1989c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:13.532715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 301/598] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:13.532715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.598361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 298/599] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:13.599879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449402da-d708-4e1e-9741-6eedda1989c2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.637913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ebf8-5670-4293-be35-ac230bb47101 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.667603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:13.673415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.674250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.674554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.674809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.687492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.688912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:13.706843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:13.707939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:13.708988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:13.708988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:13.708988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:13.708988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:13.708988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 302/600] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:13.710824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.727934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:13.733317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449402da-d708-4e1e-9741-6eedda1989c2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.774744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.775606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.775989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.776362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.777206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:13.777624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.779490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.792897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 299/601] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:13.793691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.821275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902d2b9-4e12-4295-bf0a-4295c3760350 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.857315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.858608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.858952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.859409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/58ea8ab7aaf7415ea86a0975dfe54a52/roles/664cd40cb8424f818c65b66e06e19363` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.884257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=58ea8ab7aaf7415ea86a0975dfe54a52, role_id=664cd40cb8424f818c65b66e06e19363)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:13.886500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:13.903005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5d034-2081-4d7a-bd8a-4ae2ee22b1a5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:13.904541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 303/602] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:13 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/58ea8ab7aaf7415ea86a0975dfe54a52/roles/664cd40cb8424f818c65b66e06e19363 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:13.905496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:13.957288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:13.977640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:13.978793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:13.979083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:13.979364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:13.996653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:14.007635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:14.008857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:14.009890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:14.014537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 300/603] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:14.015540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.046272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.049140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d05b21-e248-42ae-987b-28aa00de9359 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.089640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.090783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.091321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.092023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.092973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:14.093590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.095115 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.113853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 304/604] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:14.114989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.165181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450cb0-9a1b-42ec-a675-070ce0461ec3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.211752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.212800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.213226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.213665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.225691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.227480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.238520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.240785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502882b-a3ad-4a3b-bdf6-74f27fd8b3c5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:14.244227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:14.245572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:14.247073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:14.249069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 301/605] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:14.250068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.281059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.281856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.282256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.282710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.283632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:14.284042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.285700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.299628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 305/606] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:14.299628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.338416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.361591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa0c6-d977-4ef0-b8c2-cd042dffeb3c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.397206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.398451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.398930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.399419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.404181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210c14-4937-4128-9d09-adc180896b5f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.407347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.409016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:14.424462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:14.425430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:14.426348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:14.433236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 302/607] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:14.434493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.441021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.441696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.442040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.442357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.443200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:14.443512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.445016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.459008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 306/608] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:14.460323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.498655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.546957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909966b-3915-4fa0-b69d-283770dcd391 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.568750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b8cfb-6cef-40d1-927b-f86ce1f087e9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.582597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.583629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.584084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.584595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.592163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.596883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.598463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.608924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.609826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.610295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.610740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.611681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:14.612155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.613738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:14.618315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:14.619395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:14.620301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:14.620301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:14.620301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:14.620301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:14.625895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 303/609] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:14.626916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.629782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 307/610] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:14.630877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.726585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.733419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce11c76-cfa7-46b1-bf68-9d9089749502 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.736521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507f602-c264-4320-bc2d-00cea1baa276 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.768773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.769627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.769906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.770176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/30ea8e8f73ad4862a22ca7ce2b461740/roles/664cd40cb8424f818c65b66e06e19363` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.774887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.775796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.776283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.776761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.777738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:14.778336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.780029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.785404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=30ea8e8f73ad4862a22ca7ce2b461740, role_id=664cd40cb8424f818c65b66e06e19363)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.786975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.794069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 308/611] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:14.795034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.805901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 304/612] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:14 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/30ea8e8f73ad4862a22ca7ce2b461740/roles/664cd40cb8424f818c65b66e06e19363 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:14.807022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:14.862912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.909560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bb6e5-8650-493c-a64c-434bb052b20d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.927988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32354b8-688d-4c25-ae9c-60bd321131f7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:14.946664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.947837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.948149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.948527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/2fa3a98382cd4b04bb384bbc2ab3a598/roles/664cd40cb8424f818c65b66e06e19363` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.964094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:14.969777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=2fa3a98382cd4b04bb384bbc2ab3a598, role_id=664cd40cb8424f818c65b66e06e19363)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:14.971794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:14.983804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:14.984695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:14.984990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:14.985319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:14.997483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 309/613] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:14 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/2fa3a98382cd4b04bb384bbc2ab3a598/roles/664cd40cb8424f818c65b66e06e19363 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:15.002551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:15.004254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:15.021681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:15.022706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:15.023627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 305/614] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:15.031828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:15.182150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d248773-d48f-43a6-801c-cc800b5b2266 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:15.221296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:15.222014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:15.222336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:15.222618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:15.223540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:15.223855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:15.225548 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:15.249134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 310/615] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 3 12:49:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:15.254684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:15.383039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:15.386803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc6dd-2a6d-47f2-92bb-547d5ce2789e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:15.448369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:15.449200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:15.449483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:15.449760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:15.468029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:15.469522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:15.498631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:15.499586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:15.500466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:15.500466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:15.500466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:15.500466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:15.500466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 306/616] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:15.506022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:15.580337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:15.646642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f3745-3355-4739-a57a-6ff0aa419921 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:15.689615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad256696-0234-46b0-8411-38e944990875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:15.690324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad256696-0234-46b0-8411-38e944990875 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:15.690609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad256696-0234-46b0-8411-38e944990875 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:15.690887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad256696-0234-46b0-8411-38e944990875 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:15.691616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad256696-0234-46b0-8411-38e944990875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:15.691922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad256696-0234-46b0-8411-38e944990875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:15.698956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad256696-0234-46b0-8411-38e944990875 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:15.712143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 311/617] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:15.717693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:15.791638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e315-e349-41b8-bb5f-94f65aeb4b26 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:15.792761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e315-e349-41b8-bb5f-94f65aeb4b26 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:15.793521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e315-e349-41b8-bb5f-94f65aeb4b26 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:15.795816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 312/618] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:15.802458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b8f4-3747-4dbb-8ab5-07e9b4b736a9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:15.803004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b8f4-3747-4dbb-8ab5-07e9b4b736a9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:15.803670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b8f4-3747-4dbb-8ab5-07e9b4b736a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:15.835283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8ae1b8f4-3747-4dbb-8ab5-07e9b4b736a9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:15.836489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8ae1b8f4-3747-4dbb-8ab5-07e9b4b736a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:15.871685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6699c81-3709-45f1-a1bc-f35e2f3b0355 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:15.946445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:15.947178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:15.947462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:15.947739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:15.968127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:15.969631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:15.984445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 313/619] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:15.992547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:15.993462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:15.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 307/620] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:16.000303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1b8f4-3747-4dbb-8ab5-07e9b4b736a9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:16.029788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:16.052397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:16.077279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:16.179205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd448b-7648-4e65-9f78-a8bc246feff3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:16.195674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1b8f4-3747-4dbb-8ab5-07e9b4b736a9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:16.214431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:16.215655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.216309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.216856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.227834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:16.236610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:16.237590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:16.238889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:16.241351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 308/621] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:16.247923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:16.302054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:16.302750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.303032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.303309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.304114 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:16.304409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:16.305854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:16.336371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 314/622] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:16.336569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:16.343258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:16.359493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e019bf-ca4b-48c0-ba64-64508b908a9f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:16.395803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:16.396847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.397335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.397821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.398928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:16.399506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:16.401084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:16.414555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 309/623] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:16.416354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:16.548631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:16.561439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed8513-736f-4bf2-a8ba-0ab8f0adde25 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:16.600855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36343c4-f4f1-4485-a5df-84ed8e8b4ed8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:16.631002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7c804-7dc9-4091-a8a1-2ffa37918e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:16.632200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7c804-7dc9-4091-a8a1-2ffa37918e16 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.632489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7c804-7dc9-4091-a8a1-2ffa37918e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.632769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7c804-7dc9-4091-a8a1-2ffa37918e16 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/770bb4d411374e3daddba2cdf48c3c0a/roles/664cd40cb8424f818c65b66e06e19363` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.651282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7c804-7dc9-4091-a8a1-2ffa37918e16 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=770bb4d411374e3daddba2cdf48c3c0a, role_id=664cd40cb8424f818c65b66e06e19363)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:16.651866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:16.652756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7c804-7dc9-4091-a8a1-2ffa37918e16 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:16.653202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.653728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.654285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.657226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:16.670334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:16.672232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:16.676616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 315/624] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:16 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/770bb4d411374e3daddba2cdf48c3c0a/roles/664cd40cb8424f818c65b66e06e19363 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:16.676616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292b8ec-2be8-4703-84d6-570321523e90 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.676616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292b8ec-2be8-4703-84d6-570321523e90 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.676616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292b8ec-2be8-4703-84d6-570321523e90 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.676616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 316/625] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:16.684317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ab844-1c8f-4263-a38b-b8d49ac1e31c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.684640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ab844-1c8f-4263-a38b-b8d49ac1e31c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.684891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ab844-1c8f-4263-a38b-b8d49ac1e31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.703594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-aa4ab844-1c8f-4263-a38b-b8d49ac1e31c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:16.704798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa4ab844-1c8f-4263-a38b-b8d49ac1e31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:16.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:16.706416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:16.707331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:16.707331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:16.707331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:16.707331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:16.712564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 310/626] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:16.719293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:16.868036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 317/627] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:16.928202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fa48b-6c79-4ed3-b227-0ea4cf1e4ecf None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:16.931990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ab844-1c8f-4263-a38b-b8d49ac1e31c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:16.977604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:16.977855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:16.978072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:16.978281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:16.979020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:16.979324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:16.980711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:16.994084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 311/628] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:17.002285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:17.024141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:17.051401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ab844-1c8f-4263-a38b-b8d49ac1e31c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.082592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:17.088840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.090243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.090720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.091290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.103726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:17.112398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:17.113360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:17.114339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:17.117079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 318/629] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:17.123562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:17.168969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e182d-6433-43db-8131-d64a21c10908 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.243026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6e3a4-6f46-4f66-a0a2-cc58a5bd738d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.244014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.245088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.245563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.246029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.265979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:17.267890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:17.286581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:17.287626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:17.288550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:17.291643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 312/630] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:49:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:17.297794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:17.349044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.350200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.352447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.352986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.354332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:17.356526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:17.358490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:17.374594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:17.378598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 319/631] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:17.384975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:17.491961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df7806-57c7-4c98-9c23-4a03db6a6ed2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.504584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56c763-2b01-42b2-b751-c62b8b449cb5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.524026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:17.537027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.538185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.538643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.539068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.555230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:17.562965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:17.588141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.588824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.589108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.589386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.590266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:17.590630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:17.592248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:17.603493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:17.604420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:17.605291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:17.605291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:17.605291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:17.605291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:17.606365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 320/632] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:17.615362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:17.638069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 313/633] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:49:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:17.647724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:17.706510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:17.747436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeda48-0007-4719-b6ce-1568811a3dce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.773574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb357-c036-44d6-939d-a6d084922330 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.785201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f5295-d5f0-4222-810e-4c600611546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.786026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f5295-d5f0-4222-810e-4c600611546c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.786344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f5295-d5f0-4222-810e-4c600611546c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.786621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f5295-d5f0-4222-810e-4c600611546c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.787354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f5295-d5f0-4222-810e-4c600611546c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:17.787661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f5295-d5f0-4222-810e-4c600611546c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:17.789039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f5295-d5f0-4222-810e-4c600611546c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:17.802212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 321/634] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:17.803515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ef478-732a-4382-b6bb-8c40bf034594 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.803803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ef478-732a-4382-b6bb-8c40bf034594 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.804076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ef478-732a-4382-b6bb-8c40bf034594 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.805440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 322/635] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:17.809786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eabeb7-8b18-47ee-91e9-28f6e5e9064c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.809786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eabeb7-8b18-47ee-91e9-28f6e5e9064c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.809786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eabeb7-8b18-47ee-91e9-28f6e5e9064c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.809786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 323/636] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:17.809786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eabeb7-8b18-47ee-91e9-28f6e5e9064c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:17.818137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d381885-2913-4a73-bb99-7f35f7da3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.818822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d381885-2913-4a73-bb99-7f35f7da3594 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.819105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d381885-2913-4a73-bb99-7f35f7da3594 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.819390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d381885-2913-4a73-bb99-7f35f7da3594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.851391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:17.892713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d381885-2913-4a73-bb99-7f35f7da3594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:17.894711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d381885-2913-4a73-bb99-7f35f7da3594 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:17.921650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eabeb7-8b18-47ee-91e9-28f6e5e9064c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:17.931165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:17.957941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb208c0-4d02-430e-b2b9-2d2cdcfc24c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:17.958794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb208c0-4d02-430e-b2b9-2d2cdcfc24c9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.959065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb208c0-4d02-430e-b2b9-2d2cdcfc24c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.959342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb208c0-4d02-430e-b2b9-2d2cdcfc24c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:17.967686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb208c0-4d02-430e-b2b9-2d2cdcfc24c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:17.969167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb208c0-4d02-430e-b2b9-2d2cdcfc24c9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bdb208c0-4d02-430e-b2b9-2d2cdcfc24c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:17.985537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:17.986579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 324/637] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b498aa8-7831-434c-8431-9cbe559df04d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:17.992528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b498aa8-7831-434c-8431-9cbe559df04d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:17.993262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b498aa8-7831-434c-8431-9cbe559df04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.005607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7b498aa8-7831-434c-8431-9cbe559df04d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:18.006878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b498aa8-7831-434c-8431-9cbe559df04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:18.011576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 314/638] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:49:18.013918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9675ce3-e4de-4192-8088-cace71f8d513 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.018622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9675ce3-e4de-4192-8088-cace71f8d513 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.018622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9675ce3-e4de-4192-8088-cace71f8d513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.031512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a9675ce3-e4de-4192-8088-cace71f8d513 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:18.032724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a9675ce3-e4de-4192-8088-cace71f8d513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:18.085666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 325/639] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:18.091149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b498aa8-7831-434c-8431-9cbe559df04d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.096968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.118284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 315/640] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:18.119367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9675ce3-e4de-4192-8088-cace71f8d513 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.215522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.218750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b498aa8-7831-434c-8431-9cbe559df04d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.235710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9675ce3-e4de-4192-8088-cace71f8d513 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.256496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.257176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.257462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.257735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.258608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:18.258917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:18.260366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:18.274299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.275629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.275898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.276167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.283420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 326/641] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:18.283420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.292337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:18.293854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:18.313029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:18.313906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:18.314875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:18.314875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:18.314875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:18.314875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:18.318873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 316/642] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:18.319710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.367981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.392564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cf764-25c5-45a6-83f3-576ba5209dd6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.424530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d337c-a201-4b1f-97b0-6a5d39045e46 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.426670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.427481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.427760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.428033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.438765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:18.446381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:18.447380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:18.448258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 327/643] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:18.449459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.466606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.467328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.467607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.467890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.470009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.478573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:18.486494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:18.487453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 317/644] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:18.493600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.568224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6232-e12c-497f-9220-c11dac759a62 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.598773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3b872-4a74-45fd-84a1-1616c3095b82 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.602748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.603402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.603680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.603950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.606325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.635159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.635909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.636192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.636466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.637186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:18.637608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:18.639120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:18.651804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 318/645] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:18.656918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.677347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:18.679272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:18.698726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.759700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764747-e65d-4ac7-8f43-eacba7e3cbff None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.787637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 328/646] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:18.788486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.800858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.801645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.801933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.802245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.803007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:18.803319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:18.804865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:18.813526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 319/647] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:18.814389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.843943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.897254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b5a8-f4c2-49b7-adc4-380b8d457a18 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.916992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:18.924008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42c2e-a16c-408f-b081-79f16d19bed9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:18.936477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.937165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.937451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.937727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.938516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:18.938858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:18.940215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:18.949989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 329/648] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:18.950938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:18.967548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:18.968577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:18.969033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:18.969308 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:18.976462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:18.977915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:18.992436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:18.993582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 320/649] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:18.994912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.072947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7362-0dd0-4d1f-92e0-8f0735d421d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.088195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.101364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0b51-a358-4575-9ee4-85652529c4b1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.111624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.112761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.113053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.113485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.124992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.126502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.136472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.137280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.137686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.137999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:19.144491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:19.145394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:19.146298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:19.146298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:19.146298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:19.146298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:19.146298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 330/650] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:19.146588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.154148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.155634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:19.174509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:19.175442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:19.176331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:19.176331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:19.176331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:19.176331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:19.176331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 321/651] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:19.176603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.186158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.260844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbbc25-aaf5-4174-b1ca-1d7ae798c30a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.283757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6a924-48b8-4e65-9b91-bdaa8a1b97c4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.293557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.294443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.294721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.294995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.305497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.307109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.317633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.318339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.318626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.318903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.319695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:19.320009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.321472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:19.325134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:19.326770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:19.333026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:19.333026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:19.333026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:19.333026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:19.333026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 331/652] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:19.333026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.335479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.339439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 322/653] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:19.340846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.411971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.429842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a43bd-4f3e-43ba-85a7-ce7d4fc59774 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.445804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6b8f-2c21-44f6-8333-a5a13083f862 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.464679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d88f70-70dc-456f-8e44-e3e0b7077543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.465355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d88f70-70dc-456f-8e44-e3e0b7077543 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.465678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d88f70-70dc-456f-8e44-e3e0b7077543 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.465974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d88f70-70dc-456f-8e44-e3e0b7077543 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.466732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d88f70-70dc-456f-8e44-e3e0b7077543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:19.467041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d88f70-70dc-456f-8e44-e3e0b7077543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.468467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d88f70-70dc-456f-8e44-e3e0b7077543 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.479808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.480412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 332/654] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:19.480527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.480748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.481025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.481858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf3f5-d137-4b46-97de-5aa66f96c1ad None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.481958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:19.482043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf3f5-d137-4b46-97de-5aa66f96c1ad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.482142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.482317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf3f5-d137-4b46-97de-5aa66f96c1ad None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.483520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.487594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 333/655] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:19.488347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf3f5-d137-4b46-97de-5aa66f96c1ad None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.496019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 323/656] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:19.497225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.558639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.595718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf3f5-d137-4b46-97de-5aa66f96c1ad None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.598921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a28a-7d12-461d-9668-23689c04e3a4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.629613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc72de-2dee-4e4d-9068-c3693261a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.630313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc72de-2dee-4e4d-9068-c3693261a9ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.630595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc72de-2dee-4e4d-9068-c3693261a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.630871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc72de-2dee-4e4d-9068-c3693261a9ac None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.631592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc72de-2dee-4e4d-9068-c3693261a9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:19.631902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc72de-2dee-4e4d-9068-c3693261a9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.632563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.633218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.633315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc72de-2dee-4e4d-9068-c3693261a9ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.633503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.633780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.634821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=8948febd509a4edca08572764acfdcba) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:19.635142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.637005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.643067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 324/657] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/role_assignments?user.id=8948febd509a4edca08572764acfdcba&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:19.643912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.650214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 334/658] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:19.650214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c0cb-5f55-46de-be3f-9976fded6d50 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.650214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c0cb-5f55-46de-be3f-9976fded6d50 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.650214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c0cb-5f55-46de-be3f-9976fded6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.652801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.669177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ff08c0cb-5f55-46de-be3f-9976fded6d50 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:19.670659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ff08c0cb-5f55-46de-be3f-9976fded6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:19.747513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 335/659] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:19.748791 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c0cb-5f55-46de-be3f-9976fded6d50 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.778467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864b45f-4fed-40e9-9e54-4f074bf0f4c7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.805900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.818007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.818992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.819341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.819695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.827479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.828966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:19.843640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:19.844791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:19.845914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:19.846484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 325/660] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:19.847422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.872753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c0cb-5f55-46de-be3f-9976fded6d50 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.911356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:19.915768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.916597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.916885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.917157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:19.926269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:19.927856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:19.943226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:19.944834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 12:49:19.945983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:19.946661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 336/661] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:19.947357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:19.959949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06f41f-1113-40f8-81f4-da288d1fdbfb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:19.997512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:19.998352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:19.998633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:19.998902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.007732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.009351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:20.024125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:20.025139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 326/662] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:20.026616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.066029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79574f0-0215-4c60-9767-e72fe6300481 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.077321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.101621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.102376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.102657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.102929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.113714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:20.121713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:20.123348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 337/663] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:20.124175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.144643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3ed0-22f8-4370-b06f-6874bd388617 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.181238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.182239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.182880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.183852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.184344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.185459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:20.185916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.187549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.201574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 327/664] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:20.202657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.239941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64649-79be-4356-a122-02b684d303a4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.277528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.278356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.278705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.279147 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.280665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:20.280985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.282466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.308430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 338/665] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:20.308430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.315194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69b913-27c0-41d4-9343-a43db0d6b8f6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.318386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.358573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.359648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.360172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.360596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.361581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:20.362052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.363797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.384621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 328/666] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:20.385464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.416839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e91d4-a836-4a97-b05c-8d8b42462179 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.428333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.453578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.454288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.454577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.454855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.455606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:20.455919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.457441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.466042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 339/667] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:20.467120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.496815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328dce-c155-48c5-bcec-edb6ba2d5c86 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.533755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.534457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.534738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.535010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.535842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=58ea8ab7aaf7415ea86a0975dfe54a52) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:20.536160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.538242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.546341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 329/668] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/role_assignments?user.id=58ea8ab7aaf7415ea86a0975dfe54a52&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:20.555926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.587183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da8ba2-ed63-4931-aef0-de2c6f679c41 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.594939 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.627860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.628618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.628983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.629357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.675256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.690207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddab62a-a90e-4304-b2c3-bf02c9c82fd4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.705498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.707217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.731667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.732652 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.733094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.733527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.808572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:20.810240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:20.818963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 340/669] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:20.819640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.842492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.901268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:20.935963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 330/670] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:20.937241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:20.944638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb30f6-0942-408b-8a6e-11d4792d0648 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:20.985028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:20.986349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:20.986834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:20.987306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:20.999498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.001372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:21.020562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:21.021499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:21.022480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:21.022480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:21.022480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:21.022480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:21.029294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 341/671] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:21.030437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.043976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631f954-eb9c-4644-9c25-f176a8f96582 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.070529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.079524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.080301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.080582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.080853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.092254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.093713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:21.111456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:21.112362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:21.113672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:21.113672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:21.113672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:21.113672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:21.117294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 331/672] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:21.118174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.145072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5f71f-0db0-4e2f-aab9-cbc28995e042 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.170889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.183524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.184709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.185292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.185773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.198654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.200923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:21.219809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:21.220721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:21.221598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:21.221598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:21.221598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:21.221598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:21.221822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c210b-f35d-4297-a6bc-ded0cc1a97c5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.224173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 342/673] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:21.225278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.270615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.271952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.272499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.272976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.274724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:21.274724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.276101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.296955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 332/674] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:21.296955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.347495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.363748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918222e-0fdb-4bc1-a915-4ed8911e9a7a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.406328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.407102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.407385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.407661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.408451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:21.408757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.410490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.429423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 343/675] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:21.429423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.430290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8df4e1-ff72-4181-b6a9-f25e21627b2c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.467632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.468948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.469817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.470372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.470786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.471661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:21.472447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.474197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.493555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 333/676] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:21.495016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.540761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3df24-cd42-4aa3-be24-f521684af57a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.577893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.578820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.579174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.579572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.587534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.589070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.603254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:21.606783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:21.607987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:21.608918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:21.610839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd996-56b7-441a-9991-0cf3d36fcdb9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.612770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 344/677] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:21.614348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.651972 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.653080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.653718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.654216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.662623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.664589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:21.680818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:21.681904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:21.683094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:21.689908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 334/678] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:21.691012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.721157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.727816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3a8a2-b895-4df1-94d1-69c012ec1264 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.765765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.766942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.767327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.767727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.775204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.776952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:21.791911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:21.793077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:21.794434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:21.800353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 345/679] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:21.800353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.815591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4f92-5b08-4934-a027-dfdba959ea5a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.852977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.854055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.854578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.855045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.856179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:21.856740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.858492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.879143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 335/680] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:21.880432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.901688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.911570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e8423-4439-494f-8d0a-52f83176583a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:21.948144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:21.948784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:21.949029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:21.949271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:21.950299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:21.950605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:21.952070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:21.970713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 346/681] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:21.971757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:21.991378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:21.996404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0170c4-80b3-4200-91ed-168e034ad0d8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.034150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.034814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.035096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.035359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.036143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:22.036449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:22.037907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:22.053937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 336/682] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:22.053937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:22.083572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e7569-6626-40bf-9ce9-09b146645f4f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.119390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcadbfb-d43e-4b25-b6a3-b91df79753b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.120044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcadbfb-d43e-4b25-b6a3-b91df79753b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.120325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcadbfb-d43e-4b25-b6a3-b91df79753b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.120743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcadbfb-d43e-4b25-b6a3-b91df79753b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.136381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:22.160230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d10c1-45d8-4381-b086-dc45563860b5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.193813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb31af-f2dc-4d14-8ec2-7d942244c89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.194496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb31af-f2dc-4d14-8ec2-7d942244c89d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.194781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb31af-f2dc-4d14-8ec2-7d942244c89d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.195057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb31af-f2dc-4d14-8ec2-7d942244c89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.195465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcadbfb-d43e-4b25-b6a3-b91df79753b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:22.195880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb31af-f2dc-4d14-8ec2-7d942244c89d None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=2fa3a98382cd4b04bb384bbc2ab3a598) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:22.196192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb31af-f2dc-4d14-8ec2-7d942244c89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:22.196939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcadbfb-d43e-4b25-b6a3-b91df79753b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:22.197617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb31af-f2dc-4d14-8ec2-7d942244c89d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:22.203933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 337/683] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/role_assignments?user.id=2fa3a98382cd4b04bb384bbc2ab3a598&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:22.205989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50570-28f4-4b64-8770-fd481f4cd010 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.206547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50570-28f4-4b64-8770-fd481f4cd010 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.207021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50570-28f4-4b64-8770-fd481f4cd010 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.209728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 338/684] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:22.211073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c50570-28f4-4b64-8770-fd481f4cd010 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:22.216297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:22.323171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 347/685] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:22.325265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b182a-07d2-47b9-88a5-2ad54c0dc016 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.325638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b182a-07d2-47b9-88a5-2ad54c0dc016 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.325995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b182a-07d2-47b9-88a5-2ad54c0dc016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.332184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c50570-28f4-4b64-8770-fd481f4cd010 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.344634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1e5b182a-07d2-47b9-88a5-2ad54c0dc016 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:22.345889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1e5b182a-07d2-47b9-88a5-2ad54c0dc016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:22.377009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.378020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.378490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.378779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.379880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=30ea8e8f73ad4862a22ca7ce2b461740) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:22.380265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:22.382338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:22.397928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 339/686] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/role_assignments?user.id=30ea8e8f73ad4862a22ca7ce2b461740&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:22.399082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:22.406978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:22.456773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 348/687] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:22.483016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b182a-07d2-47b9-88a5-2ad54c0dc016 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:22.524829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10f3f-3627-4c6e-b2a8-d74196c9883c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.555744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:22.567926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.569011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.569463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.569895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.583291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:22.585039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:22.604671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:22.605834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:22.607057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:22.607057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:22.607057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:22.607057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:22.613491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 340/688] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:22.615502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:22.651655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b182a-07d2-47b9-88a5-2ad54c0dc016 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.692739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:22.701927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.702783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.703069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.703349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.717227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:22.726595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:22.727583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:22.729009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 349/689] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:22.733582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:22.760955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ad64b-dfe8-4572-82dd-d0c5df26b5dc None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.809697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.810760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.811052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.811334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.812502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:22.813085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:22.814540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:22.832975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 341/690] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:22.843205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:22.862386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9cf45-919d-4b80-9f71-22b8f515c911 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:22.874999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:22.908492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:22.909179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:22.909466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:22.909747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:22.910532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:22.910842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:22.912244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:22.932268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 350/691] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:22.940692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.032818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20708c56-f8a8-4b5b-a4c5-99ca1048c75b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.051647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:23.072038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7407a-6407-4bb3-ac7f-93ed3b4d5d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.073194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7407a-6407-4bb3-ac7f-93ed3b4d5d7a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.073676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7407a-6407-4bb3-ac7f-93ed3b4d5d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.074173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7407a-6407-4bb3-ac7f-93ed3b4d5d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.074588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fa859-c9d5-451f-908b-1ed40104eb59 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.082806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7407a-6407-4bb3-ac7f-93ed3b4d5d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.084372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7407a-6407-4bb3-ac7f-93ed3b4d5d7a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f6a7407a-6407-4bb3-ac7f-93ed3b4d5d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:23.099562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:23.100607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:23.101496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:23.105702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 342/692] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:23.107382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053e8ca-0dfa-4d48-b9b8-2ebfc2d5d3d1 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.107838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053e8ca-0dfa-4d48-b9b8-2ebfc2d5d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.108203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053e8ca-0dfa-4d48-b9b8-2ebfc2d5d3d1 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.110405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 343/693] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:23.111325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053e8ca-0dfa-4d48-b9b8-2ebfc2d5d3d1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.115642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffdd47-07ec-4feb-b811-f2743f16a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.117600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffdd47-07ec-4feb-b811-f2743f16a857 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.118091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffdd47-07ec-4feb-b811-f2743f16a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.118589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffdd47-07ec-4feb-b811-f2743f16a857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.135138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffdd47-07ec-4feb-b811-f2743f16a857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.137891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffdd47-07ec-4feb-b811-f2743f16a857 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a3ffdd47-07ec-4feb-b811-f2743f16a857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:23.160848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:23.161817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:23.162795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:23.162795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:23.162795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:23.162795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:23.168535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 351/694] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:23.168535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f367-8b3c-4c6e-a4e8-bf5352639017 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.168535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f367-8b3c-4c6e-a4e8-bf5352639017 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.168535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f367-8b3c-4c6e-a4e8-bf5352639017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.195566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ce05f367-8b3c-4c6e-a4e8-bf5352639017 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:23.196783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce05f367-8b3c-4c6e-a4e8-bf5352639017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:23.217561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:23.242076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053e8ca-0dfa-4d48-b9b8-2ebfc2d5d3d1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.278677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 352/695] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:23.279762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f367-8b3c-4c6e-a4e8-bf5352639017 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.289007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.289959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.290920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.291441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.292858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:23.293573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.295724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.311870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 344/696] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:23.313112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.351021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:23.385111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f367-8b3c-4c6e-a4e8-bf5352639017 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.421382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.422281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.422761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.423044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.423886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:23.424302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.425790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.426199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd398226-dfe4-4058-b01c-7b3cfedcbbd1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.442189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 353/697] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:23.442189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.457217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:23.475506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.476927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.477481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.477945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.489599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.491478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:23.511649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:23.512654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:23.513750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:23.513750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:23.513750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:23.513750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:23.515914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 345/698] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:23.517069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.550772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4edde-b8ee-46f2-8aa9-10981f4fc3ba None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.584833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.585696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.586044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.586437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.587378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=770bb4d411374e3daddba2cdf48c3c0a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:23.587793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.589344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.596340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 354/699] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/role_assignments?user.id=770bb4d411374e3daddba2cdf48c3c0a&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:23.597270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.623105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:23.639310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d93f8-22cd-4d60-bb4e-5a091fb986eb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.678561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.679314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:23.680810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.681316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.681816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.692541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.694456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:23.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:23.712898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:23.714087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:23.716628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 346/700] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:23.722517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.725047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef591fe1-6f11-48d9-a56f-8783902fa4ec None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.796016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.796779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.797167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.797546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.798423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:23.798830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.800334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.825005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 355/701] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:23.830584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.839616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76767983-caa9-460e-817b-9165ef227be7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:23.880057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:23.881030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:23.881545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:23.882017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:23.883251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:23.883715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:23.885371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:23.906795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 347/702] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:23.912857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:23.944935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:24.047644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601aeb0-be03-4f08-96df-f8bf5dc40f76 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:24.060985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1059-a6fb-43c3-9107-2cfaf5a10b92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:24.085041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:24.085449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:24.085741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:24.086022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:24.101327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:24.102702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:24.103195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:24.103676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:24.104635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:24.106491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:24.114495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:24.136728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 356/703] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:49:23 2022] POST /identity/v3/users => generated 254 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:24.168374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:24.170296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:24.180136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:24.286028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 348/704] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 12:49:24.291715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:24.412556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b64d3d-8083-42f5-b1a6-e3092c3bbc82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:24.461616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:24.462458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:24.462744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:24.463024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:24.478920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:24.480409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:24.503051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:24.504070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:24.504993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:24.504993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:24.504993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:24.504993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:24.504993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 357/705] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:24.510360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:24.637353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04517652-5d34-420d-a270-e3e09735ed08 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:24.645222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:24.673719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:24.674343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:24.674632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:24.674913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:24.675651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:24.675960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:24.677357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:24.689991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 349/706] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:24.695422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:24.742520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:24.814780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f24ef-9cc6-43b1-b801-483531d41fb8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:24.852265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07823dd-90ea-4b51-8d42-8d09130b62f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:24.853080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07823dd-90ea-4b51-8d42-8d09130b62f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:24.853366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07823dd-90ea-4b51-8d42-8d09130b62f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:24.853644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07823dd-90ea-4b51-8d42-8d09130b62f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:24.861662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07823dd-90ea-4b51-8d42-8d09130b62f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:24.863267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07823dd-90ea-4b51-8d42-8d09130b62f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f07823dd-90ea-4b51-8d42-8d09130b62f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:24.880163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:24.881166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:24.882095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 358/707] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:24.887574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:24.936856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6187ca-c0fd-4125-acae-13a9544dc2c5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:24.937157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6187ca-c0fd-4125-acae-13a9544dc2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:24.937326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6187ca-c0fd-4125-acae-13a9544dc2c5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:24.939348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 359/708] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:24.947106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152bfa1-3b5c-4d9e-a736-115b9e0fc6c4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:24.947395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152bfa1-3b5c-4d9e-a736-115b9e0fc6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:24.947972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152bfa1-3b5c-4d9e-a736-115b9e0fc6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:24.975933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e152bfa1-3b5c-4d9e-a736-115b9e0fc6c4 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:24.977172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e152bfa1-3b5c-4d9e-a736-115b9e0fc6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:25.005083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f295-7d3f-49f8-8d1f-9a3e03ef69b5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:25.060035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:25.060739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.061115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.061392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.062213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:25.062525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:25.064091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:25.085303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 360/709] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:49:25.096833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 350/710] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:25.102760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152bfa1-3b5c-4d9e-a736-115b9e0fc6c4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:25.139852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:25.159174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:25.173340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:25.250656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd250d-5808-4664-afc3-3fa9c9d27da0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:25.252261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152bfa1-3b5c-4d9e-a736-115b9e0fc6c4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:25.289401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e5e9a-9b2f-4b14-9d8c-83a215bf459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:25.290353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e5e9a-9b2f-4b14-9d8c-83a215bf459e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.290641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e5e9a-9b2f-4b14-9d8c-83a215bf459e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.290995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e5e9a-9b2f-4b14-9d8c-83a215bf459e None admin] PATH_INFO: `/v3/services/network` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.291779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e5e9a-9b2f-4b14-9d8c-83a215bf459e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:25.293272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e5e9a-9b2f-4b14-9d8c-83a215bf459e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:25.294029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8b109-5ef5-4d0b-8238-8bb58c592713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:25.295698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b109-5ef5-4d0b-8238-8bb58c592713 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.296192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b109-5ef5-4d0b-8238-8bb58c592713 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.296659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b109-5ef5-4d0b-8238-8bb58c592713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.297733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8b109-5ef5-4d0b-8238-8bb58c592713 None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=8948febd509a4edca08572764acfdcba) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:25.298288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8b109-5ef5-4d0b-8238-8bb58c592713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:25.299920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8b109-5ef5-4d0b-8238-8bb58c592713 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:25.306392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 361/711] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:25 2022] GET /identity/v3/role_assignments?user.id=8948febd509a4edca08572764acfdcba&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:25.307954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7546d-c552-4190-9b1e-17df942924f5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.308446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7546d-c552-4190-9b1e-17df942924f5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.308941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7546d-c552-4190-9b1e-17df942924f5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.315704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 362/712] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ff0e5e9a-9b2f-4b14-9d8c-83a215bf459e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:25.315931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:25.316912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:25.317769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 351/713] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:25 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:25.319326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9c38-3c1c-4947-9cf4-f545ab4d5454 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.319326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9c38-3c1c-4947-9cf4-f545ab4d5454 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.319326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9c38-3c1c-4947-9cf4-f545ab4d5454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.330941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7546d-c552-4190-9b1e-17df942924f5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:25.359356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7f1a9c38-3c1c-4947-9cf4-f545ab4d5454 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:25.360600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7f1a9c38-3c1c-4947-9cf4-f545ab4d5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:25.458645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:25.466952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7546d-c552-4190-9b1e-17df942924f5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:25.526544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 352/714] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:25.534472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:25.535236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.535640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.535980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.536815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] RBAC: Adding query filter params (name=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:25.537220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:25.538792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:25.544362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 363/715] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:25.551428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a9c38-3c1c-4947-9cf4-f545ab4d5454 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:25.564803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:25.582296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:25.669260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a9c38-3c1c-4947-9cf4-f545ab4d5454 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:25.691040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dbf0a-b8bd-4459-bb9b-45ea15eaa13a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:25.712313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:25.713243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.713753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.715265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.716469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] RBAC: Adding query filter params (type=network) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:25.717144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:25.719424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:25.732163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 353/716] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:25.751272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:25.752434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.752936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.753358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.754222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:25.755840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:25.771780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:25.773040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:25.774145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:25.777123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 364/717] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Jun 3 12:49:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:25.783298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:25.915679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:25.937445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a247-3328-4708-9cd4-8eb256801d32 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:25.975138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeee02e-b671-42ed-8313-4ecfce7827ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:25.976193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee02e-b671-42ed-8313-4ecfce7827ab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:25.976697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee02e-b671-42ed-8313-4ecfce7827ab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:25.977425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee02e-b671-42ed-8313-4ecfce7827ab None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:25.978373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeee02e-b671-42ed-8313-4ecfce7827ab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:25.978877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeee02e-b671-42ed-8313-4ecfce7827ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:25.980464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeee02e-b671-42ed-8313-4ecfce7827ab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:25.985739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 354/718] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 3 12:49:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:25.991074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:26.019311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:26.103613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88866c-2451-4983-9335-10b981d4c2bb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:26.143210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad564f10-a9e8-439e-9492-06ca1bf67ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:26.144091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad564f10-a9e8-439e-9492-06ca1bf67ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:26.144485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad564f10-a9e8-439e-9492-06ca1bf67ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:26.144769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad564f10-a9e8-439e-9492-06ca1bf67ac7 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:26.145501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad564f10-a9e8-439e-9492-06ca1bf67ac7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:26.145811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad564f10-a9e8-439e-9492-06ca1bf67ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:26.147257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad564f10-a9e8-439e-9492-06ca1bf67ac7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:26.153852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 365/719] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 3 12:49:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:26.670319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d288ba-d1ac-42fb-b73a-e34661b97b00 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:26.670745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d288ba-d1ac-42fb-b73a-e34661b97b00 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:26.670924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d288ba-d1ac-42fb-b73a-e34661b97b00 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:26.672693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 355/720] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:26.678603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596ce89-446f-4314-9b83-e190220551d2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:26.678899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596ce89-446f-4314-9b83-e190220551d2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:26.679186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596ce89-446f-4314-9b83-e190220551d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:26.703160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c596ce89-446f-4314-9b83-e190220551d2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:26.704396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c596ce89-446f-4314-9b83-e190220551d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:26.798324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 366/721] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:26.821722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d288ba-d1ac-42fb-b73a-e34661b97b00 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:26.929317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d288ba-d1ac-42fb-b73a-e34661b97b00 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:26.967380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:26.968213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:26.968498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:26.968831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:26.985963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:26.993791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:26.994792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:26.995637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 356/722] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:27.001361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596ce89-446f-4314-9b83-e190220551d2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:27.023083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:27.122754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596ce89-446f-4314-9b83-e190220551d2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:27.163334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:27.164010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:27.164294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:27.164573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:27.165323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:27.165633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:27.167040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:27.175899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 367/723] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:27.181394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:27.193779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:27.287248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c5df-4b6d-415b-a78d-b7faec5ad593 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:27.321399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ed06c-3f25-44d4-814d-46b7d761025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:27.322689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed06c-3f25-44d4-814d-46b7d761025c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:27.322973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed06c-3f25-44d4-814d-46b7d761025c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:27.323252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed06c-3f25-44d4-814d-46b7d761025c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:27.334387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ed06c-3f25-44d4-814d-46b7d761025c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:27.335875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ed06c-3f25-44d4-814d-46b7d761025c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3f5ed06c-3f25-44d4-814d-46b7d761025c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:27.353548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:27.354510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:27.355514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:27.355514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:27.355514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:27.355514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:27.355514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 357/724] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:27.361069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:27.464174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:27.481220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b2ece-a160-496b-8cf1-7243e19a43e3 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:27.481563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b2ece-a160-496b-8cf1-7243e19a43e3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:27.481842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b2ece-a160-496b-8cf1-7243e19a43e3 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:27.483254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 358/725] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:49:27.493818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e65ea-3a92-4ce2-8622-afa9d2daf2e7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:27.494127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e65ea-3a92-4ce2-8622-afa9d2daf2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:27.494437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e65ea-3a92-4ce2-8622-afa9d2daf2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:27.500873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d95bc-977f-45d6-979d-b0540b91ce22 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:27.527919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-757e65ea-3a92-4ce2-8622-afa9d2daf2e7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:27.530155 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-757e65ea-3a92-4ce2-8622-afa9d2daf2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:27.594894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:27.604423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 359/726] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 12:49:27.616179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:27.616872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:27.617156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:27.617433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:27.618192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:27.618513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:27.619908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:27.633443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 368/727] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:27.638959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e65ea-3a92-4ce2-8622-afa9d2daf2e7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:27.650964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:27.798127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e65ea-3a92-4ce2-8622-afa9d2daf2e7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:27.852924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:27.854799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:27.855074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:27.855358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:27.867632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:27.869108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:27.881433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95075035-3ba3-41f2-ac85-c455d7d00858 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:27.896994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:27.897960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:27.898944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:27.901477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 360/728] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:27.909584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:27.947143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:27.947963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:27.948248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:27.948526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:27.966540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:27.973720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:27.981667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:27.982758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:27.983592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 369/729] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:27.995125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.018499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:28.108424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e266c03-94b7-4d70-983f-d1eb5de77a25 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.145660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430b103-7221-4d07-b0b6-605b63ae3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.146460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430b103-7221-4d07-b0b6-605b63ae3ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.146748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430b103-7221-4d07-b0b6-605b63ae3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.147027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430b103-7221-4d07-b0b6-605b63ae3ee2 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.147883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430b103-7221-4d07-b0b6-605b63ae3ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:28.148193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430b103-7221-4d07-b0b6-605b63ae3ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:28.149659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430b103-7221-4d07-b0b6-605b63ae3ee2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:28.169874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 361/730] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 3 12:49:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:28.175434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea054-3c08-42c1-892f-9d67614a3109 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.175792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea054-3c08-42c1-892f-9d67614a3109 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.176015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea054-3c08-42c1-892f-9d67614a3109 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.178147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 362/731] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:28.179050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea054-3c08-42c1-892f-9d67614a3109 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.186205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33e151-2683-4560-a302-815ca4a68c1e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.226341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e52d43-43a8-441b-972b-dbf361aa3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.227195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52d43-43a8-441b-972b-dbf361aa3f7e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.227575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52d43-43a8-441b-972b-dbf361aa3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.227974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52d43-43a8-441b-972b-dbf361aa3f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.228907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52d43-43a8-441b-972b-dbf361aa3f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:28.229314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52d43-43a8-441b-972b-dbf361aa3f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:28.238146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52d43-43a8-441b-972b-dbf361aa3f7e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:28.249305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 370/732] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:28.250985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580690f-d7ee-4047-9c21-e8f2446f414e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.251538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580690f-d7ee-4047-9c21-e8f2446f414e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.251852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580690f-d7ee-4047-9c21-e8f2446f414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.271100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e580690f-d7ee-4047-9c21-e8f2446f414e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:28.272641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e580690f-d7ee-4047-9c21-e8f2446f414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:28.299347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea054-3c08-42c1-892f-9d67614a3109 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.310649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:28.339043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:28.339795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.340726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.341211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.341649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.358569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 371/733] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:28.359642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580690f-d7ee-4047-9c21-e8f2446f414e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.421494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:28.423342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:28.491997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580690f-d7ee-4047-9c21-e8f2446f414e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.538466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 363/734] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 12:49:28.539747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.542742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.543548 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.543833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.544175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.553378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:28.556632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:28.558146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:28.583549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:28.584557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:28.585510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:28.585510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:28.585510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:28.585510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:28.585510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 372/735] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:28.587965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.666619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:28.673366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd464f4-62ab-4d9f-a766-20d6f0c2b8dd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.712310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f6c69-3353-4684-b976-ae25690024b1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.715473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.715614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.715869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.716170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.726899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:28.734731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:28.735660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:28.736477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 364/736] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:28.737193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.758054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569db6fc-e480-4d4a-a94e-32727265e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.759017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569db6fc-e480-4d4a-a94e-32727265e84a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.759311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569db6fc-e480-4d4a-a94e-32727265e84a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.759593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569db6fc-e480-4d4a-a94e-32727265e84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.770771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569db6fc-e480-4d4a-a94e-32727265e84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:28.772417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569db6fc-e480-4d4a-a94e-32727265e84a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-569db6fc-e480-4d4a-a94e-32727265e84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:28.789746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:28.790724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:28.792666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:28.792666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:28.792666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:28.792666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:28.792666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 373/737] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:28.792666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495d60-4dd6-4bb6-ba94-7496671f037a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.793007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495d60-4dd6-4bb6-ba94-7496671f037a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.793007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495d60-4dd6-4bb6-ba94-7496671f037a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.794540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 374/738] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:28.795238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495d60-4dd6-4bb6-ba94-7496671f037a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.814582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:28.854814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a5ba-58fe-4b5b-8b77-f5ccb7ce1e23 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.893808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.894653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.895093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.895368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.896326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:28.896943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:28.898767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:28.899586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:28.907055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495d60-4dd6-4bb6-ba94-7496671f037a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:28.918578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 365/739] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:28.918578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:28.948032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607175b0-f463-464a-bebf-40fac8c3850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:28.948706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607175b0-f463-464a-bebf-40fac8c3850f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.948988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607175b0-f463-464a-bebf-40fac8c3850f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.949264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607175b0-f463-464a-bebf-40fac8c3850f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.950020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607175b0-f463-464a-bebf-40fac8c3850f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:28.950383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607175b0-f463-464a-bebf-40fac8c3850f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:28.952320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607175b0-f463-464a-bebf-40fac8c3850f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:28.960555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 375/740] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:28.961731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdd510-86b2-42b3-8976-f2e4c2f87150 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:28.962023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdd510-86b2-42b3-8976-f2e4c2f87150 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:28.962335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdd510-86b2-42b3-8976-f2e4c2f87150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:28.979017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d6fdd510-86b2-42b3-8976-f2e4c2f87150 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:28.980221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6fdd510-86b2-42b3-8976-f2e4c2f87150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:29.027259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f61d7-ddac-4c24-b9bc-b16e6a3f26e4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.049774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 376/741] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:29.050786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdd510-86b2-42b3-8976-f2e4c2f87150 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.062144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.071616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809f9e-584a-4bc3-9c41-8648474664bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.072299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809f9e-584a-4bc3-9c41-8648474664bf None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.072583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809f9e-584a-4bc3-9c41-8648474664bf None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.072858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809f9e-584a-4bc3-9c41-8648474664bf None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.073589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809f9e-584a-4bc3-9c41-8648474664bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:29.073880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809f9e-584a-4bc3-9c41-8648474664bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.075397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809f9e-584a-4bc3-9c41-8648474664bf None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.087714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 366/742] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:29.089070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f3c2-b0ce-4ea0-8786-bf6d89fc9b69 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.089365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f3c2-b0ce-4ea0-8786-bf6d89fc9b69 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.089642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f3c2-b0ce-4ea0-8786-bf6d89fc9b69 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.094169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 367/743] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:29.094169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497f3c2-b0ce-4ea0-8786-bf6d89fc9b69 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.142628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.155437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdd510-86b2-42b3-8976-f2e4c2f87150 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.189864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.190656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.190941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.191219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.196922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497f3c2-b0ce-4ea0-8786-bf6d89fc9b69 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.198511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.199979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:29.215016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:29.216008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:29.217106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 377/744] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:29.218019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.233032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.233843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.234146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.234434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.245048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.246556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:29.265363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:29.266478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:29.267386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:29.267386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:29.267386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:29.267386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:29.267386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 368/745] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:29.267805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.312694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.323422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8dc34-5ca5-4cbe-9cb5-d217e1094cd5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.360534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03cdc7-80af-4b8e-b0e7-b6a703e95a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.361205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03cdc7-80af-4b8e-b0e7-b6a703e95a27 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.361491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03cdc7-80af-4b8e-b0e7-b6a703e95a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.361766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03cdc7-80af-4b8e-b0e7-b6a703e95a27 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.362528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03cdc7-80af-4b8e-b0e7-b6a703e95a27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.363903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03cdc7-80af-4b8e-b0e7-b6a703e95a27 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.379174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414071-5399-41ed-8338-b6cf09489ad7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.379958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 378/746] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:49:29 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:29.381051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12259-5c42-4790-adb3-9e76e166b802 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.381343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12259-5c42-4790-adb3-9e76e166b802 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.382318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12259-5c42-4790-adb3-9e76e166b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.400406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6cc12259-5c42-4790-adb3-9e76e166b802 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:29.401666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6cc12259-5c42-4790-adb3-9e76e166b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:29.404217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.434243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.435734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.436020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.436305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.445739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.447226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:29.464482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:29.465511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:29.466720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:29.470925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 369/747] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:29.471931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.484018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 379/748] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:29 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 12:49:29.485296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12259-5c42-4790-adb3-9e76e166b802 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.603321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12259-5c42-4790-adb3-9e76e166b802 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.616529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.620904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34878-9cac-4ced-9014-70eebb7e82d8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.645204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.645979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.646353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.646698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.647496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:29.647875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.649419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.657182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.660156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.660915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.661262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.661607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.662555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:29.662938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.668199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 380/749] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:29.668345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.668457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.685900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 370/750] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:29.686990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.780315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81415a-2e48-46c0-93a6-e79cf27f6707 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.787059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eed86-cee3-4de9-9dbf-0786ab664c72 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:29.816946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.817867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.818291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.818679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.819577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:29.820140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.821769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.824327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:29.825102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:29.825518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:29.825863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:29.826705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:29.828144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:29.835195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 381/751] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:29.835989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.858146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 371/752] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:49:29 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:29.858146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:29.878249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.918638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:29.964252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77a6a4-fde4-4b3e-a9e8-bd18af54f62a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.007115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bacd7-8927-42e1-8674-69ed868ef047 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.008079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.008902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.009197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.009474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.017975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.019488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:30.035021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:30.036208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:30.037469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:30.041263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 382/753] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:30.042225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:30.060012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.060944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.061496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.062011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.156380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.157873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.165871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2205b-725e-46a4-ada4-cc06c3c3ed87 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.170838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:30.185619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:30.213305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.213987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.214296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.214713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.215713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=770bb4d411374e3daddba2cdf48c3c0a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:30.216086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.218240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.226232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 383/754] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/role_assignments?user.id=770bb4d411374e3daddba2cdf48c3c0a&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:30.227382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:30.304275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 372/755] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:49:30.315245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:30.381738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a46c-26be-4329-ba13-004b92c7a41a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.419212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.420133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.420605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.420985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.421963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:30.422414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.424093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.444296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 384/756] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:30.451042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:30.498902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:30.519393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a498-97b1-455b-9dba-147a8a25e0c6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.542261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:30.589897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.591101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.591623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965984e9-8320-4eea-8d93-71bfeafad411 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.592043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.592530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.604295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.606221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:30.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:30.627619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:30.628530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:30.628530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:30.628530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:30.628530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:30.631108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 373/757] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:30.636868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:30.675734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103f207-61c6-443a-aded-e689102220da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.676545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f207-61c6-443a-aded-e689102220da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.676830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f207-61c6-443a-aded-e689102220da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.677103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f207-61c6-443a-aded-e689102220da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.700130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103f207-61c6-443a-aded-e689102220da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.702371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103f207-61c6-443a-aded-e689102220da None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0103f207-61c6-443a-aded-e689102220da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:30.724804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:30.725814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:30.726775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:30.726775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:30.726775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:30.726775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:30.735484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 385/758] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:30.735484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103f207-61c6-443a-aded-e689102220da None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:30.777187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2377c9-7f7b-40db-a96b-8c1e42581e6a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.836964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:30.842338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.843820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.844314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.844806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.845894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:30.846453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.848075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.866169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103f207-61c6-443a-aded-e689102220da None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:30.873052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 374/759] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:30.883300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:30.917985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:30.925021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:30.925021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:30.925021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:30.925021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:30.925440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:30.925440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:30.925440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:30.949466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 386/760] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:30.952193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:31.055437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073927-e356-457e-8ee1-0687dd69cbeb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:31.116520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f938e-5e85-4b72-9500-c62abb6396f2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:31.119825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:31.120704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.121213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.121557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.139987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:31.141549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:31.158583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:31.159628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.160060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.160482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.167491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:31.169231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:31.174983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:31.175889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:31.176780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 375/761] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:31.182143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:31.188328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:31.189207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:31.190129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:31.193561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 387/762] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:31.199759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:31.228292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:31.354478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:31.374493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9de2e-96c2-481d-bb4a-a1ea11bb23b3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:31.413860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:31.415014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.415477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.415957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.416259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642b9f-1668-4522-9284-5b49fb73b826 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:31.417118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:31.417603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:31.420274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:31.437538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 376/763] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:31.442918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:31.494148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:31.495291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.496725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.498618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.499559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:31.499972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:31.501468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:31.532317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 388/764] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:31.538214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:31.633189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:31.672757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185938de-677d-4638-b25d-4dffc145d362 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:31.705131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a191e47-d536-4f82-b7ac-0f4530568da2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:31.736829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcca85-261d-4c42-9d6e-4229932c2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:31.737923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcca85-261d-4c42-9d6e-4229932c2444 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.738447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcca85-261d-4c42-9d6e-4229932c2444 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.738926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcca85-261d-4c42-9d6e-4229932c2444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.740059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcca85-261d-4c42-9d6e-4229932c2444 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=f7c40f2412c44324a20912e7564311ef) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:31.740587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcca85-261d-4c42-9d6e-4229932c2444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:31.742265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcca85-261d-4c42-9d6e-4229932c2444 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:31.749796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 377/765] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:31 2022] GET /identity/v3/role_assignments?user.id=f7c40f2412c44324a20912e7564311ef&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:31.774772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e7166-254f-4e80-a7c1-e42db57ae1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:31.776096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e7166-254f-4e80-a7c1-e42db57ae1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.776693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e7166-254f-4e80-a7c1-e42db57ae1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.777173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e7166-254f-4e80-a7c1-e42db57ae1b7 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/8948febd509a4edca08572764acfdcba/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.780106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e7166-254f-4e80-a7c1-e42db57ae1b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=8948febd509a4edca08572764acfdcba, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:31.781976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e7166-254f-4e80-a7c1-e42db57ae1b7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:31.811936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 389/766] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:31 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/8948febd509a4edca08572764acfdcba/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:31.891046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201afe-c514-4b3f-968a-ab8c5e5395d3 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.891669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201afe-c514-4b3f-968a-ab8c5e5395d3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.892153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201afe-c514-4b3f-968a-ab8c5e5395d3 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.894170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 378/767] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:31.899893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4134f-0318-4d61-9f7d-ba938eaf5437 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:31.900551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4134f-0318-4d61-9f7d-ba938eaf5437 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:31.901029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4134f-0318-4d61-9f7d-ba938eaf5437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:31.927468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-60e4134f-0318-4d61-9f7d-ba938eaf5437 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:31.929126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-60e4134f-0318-4d61-9f7d-ba938eaf5437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:32.032949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 390/768] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:32.079697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd201afe-c514-4b3f-968a-ab8c5e5395d3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:32.090088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:32.199825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd201afe-c514-4b3f-968a-ab8c5e5395d3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:32.240408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:32.241666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:32.242226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:32.242713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:32.243597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:32.245229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:32.259469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:32.261637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:32.262559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:32.265138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 379/769] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:32 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:32.271106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4134f-0318-4d61-9f7d-ba938eaf5437 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:32.360648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:32.422645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4134f-0318-4d61-9f7d-ba938eaf5437 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:32.472219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb76e1-6720-43b6-85f4-6a00679868da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:32.473165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb76e1-6720-43b6-85f4-6a00679868da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:32.473595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb76e1-6720-43b6-85f4-6a00679868da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:32.474012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb76e1-6720-43b6-85f4-6a00679868da None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:32.474920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb76e1-6720-43b6-85f4-6a00679868da None admin] RBAC: Adding query filter params (name=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:32.475374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb76e1-6720-43b6-85f4-6a00679868da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:32.476896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb76e1-6720-43b6-85f4-6a00679868da None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:32.486473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 391/770] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:32.492173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:32.594092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:32.599349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79d64-0fb2-43e5-b618-7c9062470935 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:32.599913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79d64-0fb2-43e5-b618-7c9062470935 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:32.600399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79d64-0fb2-43e5-b618-7c9062470935 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:32.602246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 392/771] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:32.607952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d760-9e6b-48ba-acae-636f04071270 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:32.608545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d760-9e6b-48ba-acae-636f04071270 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:32.609054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d760-9e6b-48ba-acae-636f04071270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:32.630161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4905d7-6265-46cc-bc3d-cf7b2e6f6ea4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:32.638650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ed27d760-9e6b-48ba-acae-636f04071270 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:32.640359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed27d760-9e6b-48ba-acae-636f04071270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:32.666710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:32.667390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:32.667677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:32.667955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:32.668668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] RBAC: Adding query filter params (type=network) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:32.668976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:32.671076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:32.676388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 380/772] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:32.681768 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:32.779985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 393/773] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:32.807744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d760-9e6b-48ba-acae-636f04071270 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:32.816388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab8368-7569-4225-81fa-e7c6b5f48b9a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:32.862896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:32.863589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:32.863874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:32.864146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:32.864956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] RBAC: Adding query filter params (interface=public, service_id=d718f62a27c840928a9af7b14b86fc64, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:32.865270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:32.869787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:32.878965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:32.889356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 381/774] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:49:32 2022] GET /identity/v3/endpoints?service_id=d718f62a27c840928a9af7b14b86fc64&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:32.897698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:32.921671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:32.972860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d760-9e6b-48ba-acae-636f04071270 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.010031 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4edbb-0287-42e6-a2d6-82660398d3f1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.011099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cce91-73aa-4de4-8796-d58d52856ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.012125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cce91-73aa-4de4-8796-d58d52856ecf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.012511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cce91-73aa-4de4-8796-d58d52856ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.012939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cce91-73aa-4de4-8796-d58d52856ecf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.013810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cce91-73aa-4de4-8796-d58d52856ecf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:33.022153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cce91-73aa-4de4-8796-d58d52856ecf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-215cce91-73aa-4de4-8796-d58d52856ecf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:33.034490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:33.035461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:33.036330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 394/775] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Jun 3 12:49:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:33.039453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826c0d-7bbc-4c43-9885-5a3742179d57 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.039453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826c0d-7bbc-4c43-9885-5a3742179d57 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.039453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f826c0d-7bbc-4c43-9885-5a3742179d57 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.039700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 395/776] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:33.042101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f826c0d-7bbc-4c43-9885-5a3742179d57 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:33.055396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f77585-645d-40ef-baa5-7ea56b68f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.056659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77585-645d-40ef-baa5-7ea56b68f232 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.057019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77585-645d-40ef-baa5-7ea56b68f232 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.057370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77585-645d-40ef-baa5-7ea56b68f232 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.058597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f77585-645d-40ef-baa5-7ea56b68f232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:33.060309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f77585-645d-40ef-baa5-7ea56b68f232 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:33.067693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 382/777] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:49:32 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:33.068923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb704-5e58-485e-8c1c-00d10f3b32de None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.069214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb704-5e58-485e-8c1c-00d10f3b32de None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.069499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb704-5e58-485e-8c1c-00d10f3b32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.104254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-631bb704-5e58-485e-8c1c-00d10f3b32de None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:33.105505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-631bb704-5e58-485e-8c1c-00d10f3b32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:33.251323 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:33.254651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f826c0d-7bbc-4c43-9885-5a3742179d57 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.279487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 383/778] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:33.282615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:33.303280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.303879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.304164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.304440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.305155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:33.305468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:33.306984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:33.307801 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb704-5e58-485e-8c1c-00d10f3b32de None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:33.313494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 396/779] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 3 12:49:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:33.323846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:33.433061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd86bd-2640-4431-b193-73b18e27d8b0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.439200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb704-5e58-485e-8c1c-00d10f3b32de None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.468644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.469372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.469655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.469964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.470786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:33.471096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:33.472585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:33.478277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 397/780] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 3 12:49:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:33.484681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:33.489833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.490697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.490982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.491259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.516205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:33.533477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:33.534501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:33.535356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 384/781] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:33.544239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:33.586550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:33.653214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:33.676114 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2145-5376-4f96-9eac-d589e50e2d62 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.720509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.721200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.721483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.721757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.722600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] RBAC: Adding query filter params (interface=public, service_id=4ac75318b6a64e33a2496bac0b815842, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:33.722912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:33.724304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:33.745601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 398/782] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:49:33 2022] GET /identity/v3/endpoints?service_id=4ac75318b6a64e33a2496bac0b815842&interface=public®ion_id=RegionOne => generated 194 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:33.746893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:33.763231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434054-26fe-44b5-9fca-21e17571bb8e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.819565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.820247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.820530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.820806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.821558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:33.821868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:33.823294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:33.835247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 385/783] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:33.842087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:33.900166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364e6e-8895-4df5-ad8d-6100799ad529 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:33.914589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:33.954833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b0821-b27b-46ca-9906-60375db884da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:33.956009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b0821-b27b-46ca-9906-60375db884da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:33.956516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b0821-b27b-46ca-9906-60375db884da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:33.956997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b0821-b27b-46ca-9906-60375db884da None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:33.957891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b0821-b27b-46ca-9906-60375db884da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:33.959526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b0821-b27b-46ca-9906-60375db884da None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:33.978304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 399/784] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:49:33 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:33.984399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cdc4d-28eb-4326-aad5-181fb354747d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:34.003098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:34.028400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:34.030205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.030498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.030779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.042944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:34.045093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:34.064938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:34.065942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:34.066868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:34.066868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:34.066868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:34.066868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:34.066868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 386/785] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:34.073281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b0821-b27b-46ca-9906-60375db884da None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:34.190619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b0821-b27b-46ca-9906-60375db884da None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:34.243786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:34.244476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.244764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.245032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.245778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:34.246081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:34.248563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:34.264825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 400/786] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:34.270455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:34.393055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8159-2b7c-464c-9254-7df1fa624309 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:34.432048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836df3c-6f87-44b1-a6ea-24ad4e454e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:34.432880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836df3c-6f87-44b1-a6ea-24ad4e454e60 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.433170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836df3c-6f87-44b1-a6ea-24ad4e454e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.433447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836df3c-6f87-44b1-a6ea-24ad4e454e60 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.443263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836df3c-6f87-44b1-a6ea-24ad4e454e60 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:34.444674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836df3c-6f87-44b1-a6ea-24ad4e454e60 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b836df3c-6f87-44b1-a6ea-24ad4e454e60 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:34.460436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:34.461432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:34.462440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 387/787] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:34.469482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:34.504647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:34.579275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6df03-052e-45ea-a590-54477bea15f3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:34.617319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:34.618003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.618318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.618592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.619433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:34.619739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:34.621314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:34.632107 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5656-c48f-434c-af44-f56555d7d04d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.632412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5656-c48f-434c-af44-f56555d7d04d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.632661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5656-c48f-434c-af44-f56555d7d04d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.634023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 388/788] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:49:34.640158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5a55-73b8-4773-90df-8f22446a470a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.640442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5a55-73b8-4773-90df-8f22446a470a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.640718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5a55-73b8-4773-90df-8f22446a470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.657195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 401/789] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 3 12:49:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:34.662680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:34.662816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-181e5a55-73b8-4773-90df-8f22446a470a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:34.664067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-181e5a55-73b8-4773-90df-8f22446a470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:34.689957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:34.745201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 389/790] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:34.777829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e6204-d1ce-43c1-a9bb-fc6bae645ea6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.778393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e6204-d1ce-43c1-a9bb-fc6bae645ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.778940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e6204-d1ce-43c1-a9bb-fc6bae645ea6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.780826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 390/791] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:49:34.788980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc45a88-734b-41d3-b7eb-0c6aec5fa769 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.789467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc45a88-734b-41d3-b7eb-0c6aec5fa769 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.789890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc45a88-734b-41d3-b7eb-0c6aec5fa769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.817298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-acc45a88-734b-41d3-b7eb-0c6aec5fa769 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:34.818697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-acc45a88-734b-41d3-b7eb-0c6aec5fa769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:34.823485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:34.835457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528469a6-f8cd-44d1-9f1e-93d903ce3f5a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:34.875913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:34.876991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:34.877420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:34.877937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:34.889275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:34.891066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:34.897122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 391/792] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:34.897988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc45a88-734b-41d3-b7eb-0c6aec5fa769 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:34.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:34.927631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:34.928754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:34.928754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:34.928754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:34.928754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:34.930159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 402/793] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:34.935861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:34.995348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.011603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc45a88-734b-41d3-b7eb-0c6aec5fa769 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.051915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.054727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.054727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.055091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.067597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64138-2466-4de5-9128-0f8b0a31436f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.070962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:35.081284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:35.082628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:35.083457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:35.084097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 392/794] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:35.084684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.110462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.111327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.111608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.111927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.124429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:35.132741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:35.133680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:35.134552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 403/795] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:35.135253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.140170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.213947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ea4b-eed1-4d63-b010-b4ee2e47b5dc None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.256026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.256591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.256918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.257258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.259260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:35.260104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.262370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.264973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ef01b-f29e-4c54-9637-d984bf4ff3ec None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.278740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 393/796] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:35.280223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.311658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.312363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.312649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.312937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.314032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:35.314528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.316252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.328751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 404/797] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:35.330258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.338504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.411504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.421102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdd699-bc26-4b24-82af-7e2b8d13c1d4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.458605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3232cf-a6ae-4ec2-b7db-70d709ff11b8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.465171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.466416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.466911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.467368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.468300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:35.468831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.470611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.480760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 394/798] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:35.482039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.502467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.503446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.503805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.504159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.512553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.514052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:35.530241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:35.531212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:35.532104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 405/799] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:35.532590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.581576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.619356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10752-c0bb-443c-9632-6645cef4490b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.641265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686dced-bc0f-4ad7-9b58-1d1e522f2c04 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.657682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.658836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.659268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.659692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.667789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.674366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.677211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.680635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a320c-8938-4192-996f-df015e0f261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.681550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a320c-8938-4192-996f-df015e0f261d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.681952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a320c-8938-4192-996f-df015e0f261d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.682357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a320c-8938-4192-996f-df015e0f261d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.693404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a320c-8938-4192-996f-df015e0f261d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.695019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a320c-8938-4192-996f-df015e0f261d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:35.697575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:35.698504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:35.699408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:35.699408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:35.699408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:35.699408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:35.701456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 395/800] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:35.702620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-945a320c-8938-4192-996f-df015e0f261d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:35.718759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:35.719709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:35.720627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:35.720627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:35.720627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:35.720627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:35.725136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 406/801] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:35.726378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a320c-8938-4192-996f-df015e0f261d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.817802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589280ff-8dfb-4b51-8940-98d7f4827c3c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.831833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a320c-8938-4192-996f-df015e0f261d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:35.839778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.856220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.857042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.857274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.857572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.858378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:35.858692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.860240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.871216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f5c3-422d-41c0-a538-03d2f64fc246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:35.872083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f5c3-422d-41c0-a538-03d2f64fc246 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.872766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 396/802] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:35.873089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f5c3-422d-41c0-a538-03d2f64fc246 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.873556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.873712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f5c3-422d-41c0-a538-03d2f64fc246 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.874688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f5c3-422d-41c0-a538-03d2f64fc246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:35.875134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f5c3-422d-41c0-a538-03d2f64fc246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:35.876776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f5c3-422d-41c0-a538-03d2f64fc246 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:35.889504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 407/803] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:35.890958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46633265-cf81-4277-b3d4-4af6a331eeec None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:35.891250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46633265-cf81-4277-b3d4-4af6a331eeec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:35.891528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46633265-cf81-4277-b3d4-4af6a331eeec None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:35.892860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 408/804] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:35.893397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46633265-cf81-4277-b3d4-4af6a331eeec None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:35.931459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:35.982158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba284b9-ecd6-4e61-adbf-4f6b8d9fb20c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.003557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46633265-cf81-4277-b3d4-4af6a331eeec None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.023871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.025017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.025526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.026021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.027426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:36.027974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.031317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.039604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104e6c-0392-4553-93e9-0dcab59c06a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.040674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e6c-0392-4553-93e9-0dcab59c06a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.041105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e6c-0392-4553-93e9-0dcab59c06a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.041557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e6c-0392-4553-93e9-0dcab59c06a6 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/770bb4d411374e3daddba2cdf48c3c0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.043809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104e6c-0392-4553-93e9-0dcab59c06a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=770bb4d411374e3daddba2cdf48c3c0a, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.045493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104e6c-0392-4553-93e9-0dcab59c06a6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.056247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 397/805] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:36.056247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.065642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 409/806] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:35 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/770bb4d411374e3daddba2cdf48c3c0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:36.067201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449987e-4c49-46bc-a8ec-8e8c2b66a2b8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.067642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449987e-4c49-46bc-a8ec-8e8c2b66a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.068125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449987e-4c49-46bc-a8ec-8e8c2b66a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.098587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f449987e-4c49-46bc-a8ec-8e8c2b66a2b8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:36.100507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f449987e-4c49-46bc-a8ec-8e8c2b66a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:36.123246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:36.190661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6d9f9-d4e1-4229-9285-090cefa16360 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.224724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 410/807] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:36.226401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449987e-4c49-46bc-a8ec-8e8c2b66a2b8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.229266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.230599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.231069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.231519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.240098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.241800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:36.270609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:36.271657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:36.272591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:36.273138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:36.275691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 398/808] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:36.280840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.357210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449987e-4c49-46bc-a8ec-8e8c2b66a2b8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.396258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:36.398994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.399466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2c1e4-fa85-4db3-b33e-26fa759ad0f5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.400353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.401064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.401594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.412237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.414651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:36.433889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:36.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:49:36.436116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:36.438797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.439348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 411/809] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:36.439519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.439793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.440073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] PATH_INFO: `/v3/services/network` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.440827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.441226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.446711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:36.461739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:36.462856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:36.463708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 399/810] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:36.464511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.559645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:36.577645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12dad-95e2-4892-aa89-ce119ff54faa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.592036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d446-98cf-45b1-ba3b-1cdac4142536 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.615156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.616058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.616509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.616933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.617910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:36.618418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.620009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.634981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.635815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.636677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.637071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.638388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:36.638833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.640389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.645486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 412/811] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:36.646102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.673906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 400/812] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:36.673906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.698434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:36.779463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bda1f1-ff1a-4cea-9724-ab2cfdc5ab61 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.791279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a605db-0126-4a36-ab17-57fa0455f66d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.815693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.816376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.816664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.816951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.817662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] RBAC: Adding query filter params (name=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:36.817969 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.819379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.828833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 413/813] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:36.828833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.835547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:36.837896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf68549-1074-43a5-a3aa-340cacf8d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.838959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf68549-1074-43a5-a3aa-340cacf8d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.839247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf68549-1074-43a5-a3aa-340cacf8d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.839523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf68549-1074-43a5-a3aa-340cacf8d4b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.850544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf68549-1074-43a5-a3aa-340cacf8d4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:36.852009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf68549-1074-43a5-a3aa-340cacf8d4b8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-bdf68549-1074-43a5-a3aa-340cacf8d4b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:36.871381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:36.872697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:36.873600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:36.873600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:36.873600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:36.873600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:36.873600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 401/814] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:36.874457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03df4-8a40-4b82-bcd4-0cbad3387004 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.874457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03df4-8a40-4b82-bcd4-0cbad3387004 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.874710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03df4-8a40-4b82-bcd4-0cbad3387004 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.876120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 402/815] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:36.876686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d03df4-8a40-4b82-bcd4-0cbad3387004 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:36.937716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9958f-3985-4e58-ba0b-6c41b615a065 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:36.962073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:36.973208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e94ff-d6f0-4771-a380-f6a6ab40dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:36.973875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e94ff-d6f0-4771-a380-f6a6ab40dffb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:36.974194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e94ff-d6f0-4771-a380-f6a6ab40dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:36.974704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e94ff-d6f0-4771-a380-f6a6ab40dffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:36.992061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d03df4-8a40-4b82-bcd4-0cbad3387004 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.027508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.028190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.028478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.028817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.029726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] RBAC: Adding query filter params (type=network) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:37.030044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.031457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.036375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 403/816] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:37.037151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.054365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e94ff-d6f0-4771-a380-f6a6ab40dffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.055945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e94ff-d6f0-4771-a380-f6a6ab40dffb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.065671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:37.138877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fb11-f97e-47c6-9f33-7b1d06167abd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.159579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 414/817] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:49:37.160685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650291-b458-46a5-b64f-732dfcbcfcf7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.160980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650291-b458-46a5-b64f-732dfcbcfcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.161262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650291-b458-46a5-b64f-732dfcbcfcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.177860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.178666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.178957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.179058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-12650291-b458-46a5-b64f-732dfcbcfcf7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:37.179254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.179990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:37.180273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.180365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12650291-b458-46a5-b64f-732dfcbcfcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:37.181653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.189138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:37.199609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 404/818] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:37.200570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.253699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 415/819] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:37.254390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650291-b458-46a5-b64f-732dfcbcfcf7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.296578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:37.322868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ead21-693b-4aa4-8203-988ca40f6f45 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.360759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650291-b458-46a5-b64f-732dfcbcfcf7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.363222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.363895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.364265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.364553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.365302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.366767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.404407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.405173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.405433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.405781 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.406533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 405/820] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:49:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:37.407434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.418172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.419798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:37.447965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:37.449017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:37.449912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:37.449912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:37.449912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:37.449912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:37.449912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 416/821] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:37.450702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.487016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:37.550450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da456e-2d8f-420e-8a0b-06b76a6c0eba None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.573588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:37.593680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c47500-04ae-4bc6-9858-d36184d7745d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.594657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.595876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.596414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.596895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.605567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.608011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:37.627060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:37.627985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:37.628883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:37.631155 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 406/822] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:37.631517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.632352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.632643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.632924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.633194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.633587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.635233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:37.650509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:37.651488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 12:49:37.652739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:37.653809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 417/823] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:37.654049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.760230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37bfe4-f13d-4855-a218-b760736af432 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.774724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:37.783589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396a8f-e796-4e54-8586-628d935a5045 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.795444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.796148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.796437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.796718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.797449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:37.797760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.799184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.815070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 407/824] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:37.815070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.828792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.829476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.829762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.830038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.830876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:37.831187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.832643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.845239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 418/825] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:37.846072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.860421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:37.925135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788fb8-3626-428e-958e-331e17db87ad None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.955769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd193-4270-4d00-b097-a8102f44a7a7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:37.961175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.961860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.962167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.962451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:37.963166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:37.963476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:37.964982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:37.970219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 408/826] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:37.970219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:37.998180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:37.999135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:37.999418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:37.999698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.006806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:38.008257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:38.014455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:38.022038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:38.023171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 419/827] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:38.024093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:38.088294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1ec66-95bc-4970-8d2f-2fc123c6fdea None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:38.106594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:38.127825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:38.128752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.129037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.129313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/f7c40f2412c44324a20912e7564311ef/roles/664cd40cb8424f818c65b66e06e19363` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.142756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630451bd-80a1-489d-8e49-54182981f20d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:38.146948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=f7c40f2412c44324a20912e7564311ef, role_id=664cd40cb8424f818c65b66e06e19363)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:38.148424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:38.163357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 409/828] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:37 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/f7c40f2412c44324a20912e7564311ef/roles/664cd40cb8424f818c65b66e06e19363 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:38.164512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:38.194820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:38.196288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.196761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.197709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.198704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:38.199383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:38.202055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:38.210685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 420/829] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 3 12:49:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:38.218045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:38.305935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:38.327725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f1665-89c5-49bd-8637-481353f71d3b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:38.348350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca47f-a635-48c0-bd06-bc00d18ce8c5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:38.382282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:38.383496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.384325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.384878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.385943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:38.386435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:38.388116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:38.389100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce9ca4-f076-4bb2-b798-33825b904efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:38.389827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9ca4-f076-4bb2-b798-33825b904efc None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.390195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9ca4-f076-4bb2-b798-33825b904efc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.390441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9ca4-f076-4bb2-b798-33825b904efc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.391339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce9ca4-f076-4bb2-b798-33825b904efc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:38.392720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce9ca4-f076-4bb2-b798-33825b904efc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:38.397516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:38.403607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 410/830] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:38.410407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:38.422991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 421/831] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:49:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:38.460916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465efcfc-560e-4a28-a088-696933fcc1d4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.461241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465efcfc-560e-4a28-a088-696933fcc1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.461485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465efcfc-560e-4a28-a088-696933fcc1d4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.462980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 422/832] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:38.469346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0057bb-6831-4ceb-a9bc-d6a7f3263a04 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.469713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0057bb-6831-4ceb-a9bc-d6a7f3263a04 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.469891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0057bb-6831-4ceb-a9bc-d6a7f3263a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.487966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1b0057bb-6831-4ceb-a9bc-d6a7f3263a04 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:38.489233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1b0057bb-6831-4ceb-a9bc-d6a7f3263a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:38.553361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034e4a-68fe-4d49-9042-bb0ffd567bea None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:38.576511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 423/833] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:38.595412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0057bb-6831-4ceb-a9bc-d6a7f3263a04 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:38.603201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:38.604433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.605053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.605556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.606833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=8948febd509a4edca08572764acfdcba) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:38.607470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:38.609375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:38.622766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 411/834] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:38 2022] GET /identity/v3/role_assignments?user.id=8948febd509a4edca08572764acfdcba&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:38.719143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0057bb-6831-4ceb-a9bc-d6a7f3263a04 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:38.739302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:38.760381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:38.761201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.761480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.761750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.774575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:38.782802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:38.783822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:38.785092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 424/835] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:38.792008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:38.809967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:38.904499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f4e0f-bbb4-46cd-a0f4-3a3caad8b48b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:38.940405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:38.941086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:38.941364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:38.941632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:38.945177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:38.945491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:38.946974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:38.963915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 412/836] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:38.970363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:39.073607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ea41-df73-4f39-aff3-5c35e0b6f9cb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:39.113047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:39.113851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:39.114209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:39.114426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:39.125947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:39.127431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:39.144507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:39.145494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:39.146656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:39.146656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:39.146656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:39.146656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:39.146656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 425/837] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:39.155628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:39.241336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:39.268092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01383-f5cc-43bb-981e-52a7b5dbc2e3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:39.303817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:39.304490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:39.304772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:39.305047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:39.305773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:39.306080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:39.307483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:39.320434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 413/838] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:39.326303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:39.357312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:39.438365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e3794-f772-4431-b45d-9619417a2cd6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:39.472544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dce77-c670-4454-9235-c8668689b913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:39.473401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dce77-c670-4454-9235-c8668689b913 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:39.473685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dce77-c670-4454-9235-c8668689b913 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:39.473959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dce77-c670-4454-9235-c8668689b913 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:39.481387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dce77-c670-4454-9235-c8668689b913 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:39.482990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dce77-c670-4454-9235-c8668689b913 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-641dce77-c670-4454-9235-c8668689b913 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:39.498277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:39.499280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:39.500389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 426/839] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:49:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:39.507302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:39.629311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c45fa-a8ac-4fec-9e1e-ac785c334f04 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:39.664579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:39.665258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:39.665542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:39.665819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:39.666691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:39.667006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:39.668444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:39.670651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:39.687425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 414/840] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 3 12:49:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:39.693451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dce77-c670-4454-9235-c8668689b913 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:39.788181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:39.801275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dce77-c670-4454-9235-c8668689b913 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:39.835375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:39.836032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:39.836321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:39.836593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:39.907306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:39.908774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:39.995668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:40.009469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 427/841] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:49:40.015580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:40.120898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7718e-bbf0-4ed1-bcc0-0bd8ffbf7144 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:40.157543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:40.158374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.158658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.158930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.169856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:40.171660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:40.190223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:40.191174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:40.192509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:40.192509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:40.192509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:40.192509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:40.192509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 415/842] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:40.198825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:40.314098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb28dc-fff5-4d3d-b66d-0a84f202a94a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:40.349084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:40.349765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.350050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.350356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.351084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:40.351393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:40.352839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:40.365415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 428/843] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:40.371277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:40.422191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:40.477854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8139f-dd5a-4516-9c8d-ed69cef4a869 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:40.517274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecbe76-4502-45ab-9de8-280d89671ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:40.518094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecbe76-4502-45ab-9de8-280d89671ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.518410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecbe76-4502-45ab-9de8-280d89671ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.518685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecbe76-4502-45ab-9de8-280d89671ef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.526276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecbe76-4502-45ab-9de8-280d89671ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:40.527781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecbe76-4502-45ab-9de8-280d89671ef7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c7ecbe76-4502-45ab-9de8-280d89671ef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:40.545603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:40.546964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:40.547846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 416/844] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:40.557481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:40.611022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:40.626884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6a7a-1120-414b-ba23-2b3b43754d5e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.627225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6a7a-1120-414b-ba23-2b3b43754d5e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.627441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6a7a-1120-414b-ba23-2b3b43754d5e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.629078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 417/845] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:49:40.634301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a78fe-e8f6-4695-89c7-7215f9082175 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.634585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a78fe-e8f6-4695-89c7-7215f9082175 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.634868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a78fe-e8f6-4695-89c7-7215f9082175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.652516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-055a78fe-e8f6-4695-89c7-7215f9082175 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:40.653783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-055a78fe-e8f6-4695-89c7-7215f9082175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:40.672229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f84cf-be39-4c2d-ba2c-68eb2519c248 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:40.708480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:40.710180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.710692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.711173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.712186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:40.712710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:40.714442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:40.732337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 429/846] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:40.732549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 418/847] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:40.739176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:40.755077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a78fe-e8f6-4695-89c7-7215f9082175 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:40.789845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:40.856330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e000c-a0e3-4468-a3d3-43da7215cc45 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:40.863941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a78fe-e8f6-4695-89c7-7215f9082175 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:40.867686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:40.895984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cda76e-116f-4569-9811-905bfd768e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:40.897029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda76e-116f-4569-9811-905bfd768e2c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.897525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda76e-116f-4569-9811-905bfd768e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.898028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda76e-116f-4569-9811-905bfd768e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.899088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cda76e-116f-4569-9811-905bfd768e2c None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=770bb4d411374e3daddba2cdf48c3c0a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:40.899557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:40.899847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cda76e-116f-4569-9811-905bfd768e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:40.900365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.900648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.900925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.902166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cda76e-116f-4569-9811-905bfd768e2c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:40.908786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 430/848] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:40 2022] GET /identity/v3/role_assignments?user.id=770bb4d411374e3daddba2cdf48c3c0a&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:40.910365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ab2e-4479-4e28-93b5-5a418a3a157d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.910875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ab2e-4479-4e28-93b5-5a418a3a157d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.911350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ab2e-4479-4e28-93b5-5a418a3a157d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.913077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 431/849] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:40.913208 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:40.922536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:40.923569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:40.924415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 419/850] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:49:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:40.927433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab428-0011-41ad-97aa-d32180e850fc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:40.927967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab428-0011-41ad-97aa-d32180e850fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:40.928470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab428-0011-41ad-97aa-d32180e850fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:40.932100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:40.947511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1ffab428-0011-41ad-97aa-d32180e850fc None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:40.949160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1ffab428-0011-41ad-97aa-d32180e850fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:41.050371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 432/851] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:41.054251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.062645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5114ee-413c-4c8e-8aa7-7a48a8edd27f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.071776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffab428-0011-41ad-97aa-d32180e850fc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.117817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.118454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.118742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.119020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.120264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:41.120264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.121696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.131727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 420/852] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:49:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:41.137120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.186913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffab428-0011-41ad-97aa-d32180e850fc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.188652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.226669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12502-1d6e-4e34-91f3-bb7bd5645bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.227483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12502-1d6e-4e34-91f3-bb7bd5645bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.227763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12502-1d6e-4e34-91f3-bb7bd5645bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.228037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12502-1d6e-4e34-91f3-bb7bd5645bc0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.228689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12502-1d6e-4e34-91f3-bb7bd5645bc0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.230060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12502-1d6e-4e34-91f3-bb7bd5645bc0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1ad12502-1d6e-4e34-91f3-bb7bd5645bc0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:41.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:41.243601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:41.244467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 433/853] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:41.245280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c10d4-3e8f-423b-bbcc-f829e865b645 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.245280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c10d4-3e8f-423b-bbcc-f829e865b645 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.246261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c10d4-3e8f-423b-bbcc-f829e865b645 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.246877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 434/854] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:41.251955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a298-3e4a-4437-8503-7c92dd0a8c51 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.253748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c10d4-3e8f-423b-bbcc-f829e865b645 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.289136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61af57-f3e7-4413-a440-14e65d81b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.289960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61af57-f3e7-4413-a440-14e65d81b411 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.290270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61af57-f3e7-4413-a440-14e65d81b411 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.290555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61af57-f3e7-4413-a440-14e65d81b411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.302039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61af57-f3e7-4413-a440-14e65d81b411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.303528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61af57-f3e7-4413-a440-14e65d81b411 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ee61af57-f3e7-4413-a440-14e65d81b411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:41.324122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:41.325100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:41.326138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:41.326138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:41.326138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:41.326138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:41.326138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 421/855] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:41.326975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6e681-4686-4ede-8dff-76aa51d1c9f5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.326975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6e681-4686-4ede-8dff-76aa51d1c9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.327156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6e681-4686-4ede-8dff-76aa51d1c9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.346342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5de6e681-4686-4ede-8dff-76aa51d1c9f5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:41.347546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5de6e681-4686-4ede-8dff-76aa51d1c9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:41.349767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.379518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c10d4-3e8f-423b-bbcc-f829e865b645 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.417343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.418012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.418319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.418597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.422213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 422/856] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:41.422361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:41.422361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.422535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6e681-4686-4ede-8dff-76aa51d1c9f5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.422614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.430215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 435/857] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:41.436180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.468566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.543164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6e681-4686-4ede-8dff-76aa51d1c9f5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.544991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770ffa-d214-4204-97e1-d8d1dd606f17 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.580996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.581670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.581961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.582277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.582991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:41.583305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.583602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.584447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.584695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.585040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.585462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.586583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:41.586899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.588300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.589829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 436/858] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:41.590646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.601160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.612660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 423/859] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:41.613685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.728884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135731-d0d3-4017-ad56-9fc99d8d5b85 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.749127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d5ef-2be2-4d23-8e0f-f38cce8cd584 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.754658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.767107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.768154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.768457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.768743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.769473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.771192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:41.784118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:41.785170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:41.786013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:41.790713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 437/860] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:41.792041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.800737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.801924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.802485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.803484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.815454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.817711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:41.836894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:41.837859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:41.841431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 424/861] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:41.845484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.900547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91053c6-083d-4501-bef4-b05bcce2be23 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:41.930975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.940493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:41.941080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:41.941365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:41.941650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:41.942426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:41.942738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:41.944257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:41.949831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 438/862] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:41.955145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:41.980771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:41.981067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ba099-0d75-40f7-8fda-7c06bf25a080 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:42.019617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:42.020642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:42.021121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:42.021572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:42.022630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:42.023118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:42.024735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:42.045360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 425/863] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:42.052917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:42.067389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb2b3-8c6d-49d3-813f-4cf29b227a3d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:42.106368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:42.107107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:42.107391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:42.107668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:42.108391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:42.108697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:42.110098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:42.115263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 439/864] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:42.176433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138891da-bea7-4fa9-8ddc-d42411bd1e66 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:42.196912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:42.223532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:42.224506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:42.224969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:42.225396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:42.308722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:42.311341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:42.421662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 426/865] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:49:42.427227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:42.519985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:42.546665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f7f83-9d7f-4246-a7f7-ce291283ba3e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:42.581082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:42.581810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:42.582091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:42.582436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:42.593260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:42.594760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:42.612824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:42.613765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:42.614693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:42.614693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:42.614693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:42.614693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:42.614693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 440/866] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:42.619899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:42.639066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:42.727462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96158af-df90-4225-90b9-53cff1debc67 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:42.764575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:42.765295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:42.765582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:42.765860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:42.766618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:42.766928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:42.768318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:42.781283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 427/867] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:42.786500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:42.890329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122538d-c6c1-464b-b7d3-a7cc7300b794 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:42.925707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:42.926605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:42.926924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:42.927210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:42.938613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:42.940089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:42.941879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:42.956355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:42.957314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:42.958228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 441/868] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:42.963609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:43.051753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:43.075027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffad63-13d0-4d0e-a43d-333ad7a6fa0b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:43.109491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dffe90-fd14-42d2-9d7b-f21c10c5770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:43.110186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffe90-fd14-42d2-9d7b-f21c10c5770d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:43.110475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffe90-fd14-42d2-9d7b-f21c10c5770d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:43.110753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffe90-fd14-42d2-9d7b-f21c10c5770d None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:43.111550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dffe90-fd14-42d2-9d7b-f21c10c5770d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:43.111859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dffe90-fd14-42d2-9d7b-f21c10c5770d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:43.113307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dffe90-fd14-42d2-9d7b-f21c10c5770d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:43.126529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 428/869] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:43.132718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:43.257267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0a76-18b8-430e-a4f9-8f2c193ed8b8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:43.298644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648ec1-df35-4df4-be43-6231f28964fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:43.299308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648ec1-df35-4df4-be43-6231f28964fe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:43.299594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648ec1-df35-4df4-be43-6231f28964fe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:43.301609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648ec1-df35-4df4-be43-6231f28964fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:43.302496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648ec1-df35-4df4-be43-6231f28964fe None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=f7c40f2412c44324a20912e7564311ef) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:43.302813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648ec1-df35-4df4-be43-6231f28964fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:43.304542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648ec1-df35-4df4-be43-6231f28964fe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:43.312874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 442/870] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:43 2022] GET /identity/v3/role_assignments?user.id=f7c40f2412c44324a20912e7564311ef&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:43.350265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c10efb-a6bd-44c3-a826-b6445408b293 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:43.350265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c10efb-a6bd-44c3-a826-b6445408b293 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:43.350265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c10efb-a6bd-44c3-a826-b6445408b293 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:43.350265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 429/871] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:43.357571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645619-9d25-409c-8ecb-2f7d55b2f3bd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:43.357937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645619-9d25-409c-8ecb-2f7d55b2f3bd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:43.358189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645619-9d25-409c-8ecb-2f7d55b2f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:43.377353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ee645619-9d25-409c-8ecb-2f7d55b2f3bd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:43.378632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ee645619-9d25-409c-8ecb-2f7d55b2f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:43.457355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:43.470101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 443/872] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:43.496525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c10efb-a6bd-44c3-a826-b6445408b293 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:43.629994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c10efb-a6bd-44c3-a826-b6445408b293 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:43.672580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:43.673397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:43.673679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:43.673951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:43.674635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:43.676177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:43.679889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:43.704642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:43.705789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:43.706689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 430/873] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:43.714303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee645619-9d25-409c-8ecb-2f7d55b2f3bd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:43.836549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee645619-9d25-409c-8ecb-2f7d55b2f3bd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:43.875944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5535d-3f24-414b-a140-6e27f9519362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:43.876627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5535d-3f24-414b-a140-6e27f9519362 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:43.876910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5535d-3f24-414b-a140-6e27f9519362 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:43.877186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5535d-3f24-414b-a140-6e27f9519362 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:43.877904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5535d-3f24-414b-a140-6e27f9519362 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:43.878236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5535d-3f24-414b-a140-6e27f9519362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:43.879628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5535d-3f24-414b-a140-6e27f9519362 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:43.885207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 444/874] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:43.890908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:44.009698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6950d-a134-4884-8233-190caeacb943 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:44.050610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a3e24-a2d7-48ce-b2f5-fa2389b83126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:44.051708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a3e24-a2d7-48ce-b2f5-fa2389b83126 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:44.052178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a3e24-a2d7-48ce-b2f5-fa2389b83126 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:44.052653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a3e24-a2d7-48ce-b2f5-fa2389b83126 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:44.053899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a3e24-a2d7-48ce-b2f5-fa2389b83126 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:44.054446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a3e24-a2d7-48ce-b2f5-fa2389b83126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:44.056695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a3e24-a2d7-48ce-b2f5-fa2389b83126 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:44.063783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 431/875] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:44.147760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6da41-c729-40a1-bf45-7c5965d203ee None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:44.147950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6da41-c729-40a1-bf45-7c5965d203ee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:44.148224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6da41-c729-40a1-bf45-7c5965d203ee None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:44.150072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 445/876] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:44.156204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a81f50-1550-43d0-8836-445a751ccedb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:44.156503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a81f50-1550-43d0-8836-445a751ccedb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:44.156767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a81f50-1550-43d0-8836-445a751ccedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:44.187378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-18a81f50-1550-43d0-8836-445a751ccedb None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:44.188790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-18a81f50-1550-43d0-8836-445a751ccedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:44.265714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:44.275245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 432/877] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:44.298067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6da41-c729-40a1-bf45-7c5965d203ee None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:44.365730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:44.415238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6da41-c729-40a1-bf45-7c5965d203ee None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:44.451039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430964d-3b31-4d21-89c2-98a0ea842061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:44.451708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430964d-3b31-4d21-89c2-98a0ea842061 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:44.451987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430964d-3b31-4d21-89c2-98a0ea842061 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:44.452262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430964d-3b31-4d21-89c2-98a0ea842061 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:44.452975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430964d-3b31-4d21-89c2-98a0ea842061 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:44.454367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430964d-3b31-4d21-89c2-98a0ea842061 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:44.474262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 446/878] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:49:44 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:44.645491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983ebc-fb1e-4887-9557-028639a2cba6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:44.646585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983ebc-fb1e-4887-9557-028639a2cba6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:44.647082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983ebc-fb1e-4887-9557-028639a2cba6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:44.649064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 433/879] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:44.655378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7a5f-1dd6-4e5d-846f-ec81b43937b7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:44.655673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7a5f-1dd6-4e5d-846f-ec81b43937b7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:44.655925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7a5f-1dd6-4e5d-846f-ec81b43937b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:44.674195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6cdb7a5f-1dd6-4e5d-846f-ec81b43937b7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:44.676507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6cdb7a5f-1dd6-4e5d-846f-ec81b43937b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:44.756029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 447/880] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:44.778760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c983ebc-fb1e-4887-9557-028639a2cba6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:44.886638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c983ebc-fb1e-4887-9557-028639a2cba6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:44.922469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757978b-0e8d-4afc-972c-da25fc17c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:44.923142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757978b-0e8d-4afc-972c-da25fc17c46c None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:44.923424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757978b-0e8d-4afc-972c-da25fc17c46c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:44.923700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757978b-0e8d-4afc-972c-da25fc17c46c None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:44.924470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757978b-0e8d-4afc-972c-da25fc17c46c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:44.925805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757978b-0e8d-4afc-972c-da25fc17c46c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:44.943431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 434/881] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:49:44 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:45.857052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac9059-7e1c-4bd1-9c80-9a4cfa29b21b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:45.858079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac9059-7e1c-4bd1-9c80-9a4cfa29b21b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:45.858618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac9059-7e1c-4bd1-9c80-9a4cfa29b21b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:45.860465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 448/882] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:45.865984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f2262-5890-4fbc-8f86-34ffa2689e9c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:45.866418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f2262-5890-4fbc-8f86-34ffa2689e9c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:45.866586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f2262-5890-4fbc-8f86-34ffa2689e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:45.884418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b31f2262-5890-4fbc-8f86-34ffa2689e9c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:45.885940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b31f2262-5890-4fbc-8f86-34ffa2689e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:45.938061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:45.963041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 435/883] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:45.986525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac9059-7e1c-4bd1-9c80-9a4cfa29b21b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:46.033520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:46.104945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac9059-7e1c-4bd1-9c80-9a4cfa29b21b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:46.145918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:46.147023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.147474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.147909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.158708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:46.167105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:46.168264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:49:46.169337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:46.171839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 449/884] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 3 12:49:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:46.177618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f2262-5890-4fbc-8f86-34ffa2689e9c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:46.287785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f2262-5890-4fbc-8f86-34ffa2689e9c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:46.323340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0b4ea-24b2-4335-81cb-6bf237ff09bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:46.324033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b4ea-24b2-4335-81cb-6bf237ff09bb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.324320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b4ea-24b2-4335-81cb-6bf237ff09bb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.324600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b4ea-24b2-4335-81cb-6bf237ff09bb None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.325361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b4ea-24b2-4335-81cb-6bf237ff09bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:46.325694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b4ea-24b2-4335-81cb-6bf237ff09bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:46.327143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b4ea-24b2-4335-81cb-6bf237ff09bb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:46.336240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 436/885] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 3 12:49:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:46.342487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:46.400393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722fa77-7eb8-45ca-afca-785f54fd25f6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.400575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722fa77-7eb8-45ca-afca-785f54fd25f6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.400866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722fa77-7eb8-45ca-afca-785f54fd25f6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.402590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 437/886] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:46.408154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfe1e9-527e-48c8-aea1-e22bfc776067 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.408450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfe1e9-527e-48c8-aea1-e22bfc776067 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.408731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfe1e9-527e-48c8-aea1-e22bfc776067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.431745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4ebfe1e9-527e-48c8-aea1-e22bfc776067 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:46.433361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4ebfe1e9-527e-48c8-aea1-e22bfc776067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:46.471319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f89d-5ef1-4b93-90cf-1cccd253679b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:46.473845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:46.480995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:46.524057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:46.525141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.525602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.526031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.534182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 438/887] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:46.542639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:46.544143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:46.552746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfe1e9-527e-48c8-aea1-e22bfc776067 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:46.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:46.567020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:46.567926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:46.567926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:46.567926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:46.567926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:46.567926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 450/888] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:46.575337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:46.663905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfe1e9-527e-48c8-aea1-e22bfc776067 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:46.699460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:46.700316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db00d-4385-48ec-8788-0c81bec7673a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:46.700469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.700707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.701019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.701753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:46.703190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:46.722158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 439/889] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:49:46 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:49:46.757435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6563f7a-9bb2-4d50-9d16-c9bac488ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:46.758552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6563f7a-9bb2-4d50-9d16-c9bac488ea00 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.759041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6563f7a-9bb2-4d50-9d16-c9bac488ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.759673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6563f7a-9bb2-4d50-9d16-c9bac488ea00 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.760617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6563f7a-9bb2-4d50-9d16-c9bac488ea00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:46.761131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6563f7a-9bb2-4d50-9d16-c9bac488ea00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:46.762832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6563f7a-9bb2-4d50-9d16-c9bac488ea00 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:46.777155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 451/890] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:46.783523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:46.821023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:46.836281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3febf46-2b20-4b60-b56c-df3b6c848f2e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.836907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3febf46-2b20-4b60-b56c-df3b6c848f2e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.837407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3febf46-2b20-4b60-b56c-df3b6c848f2e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.840067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 452/891] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:46.844904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5150-7d4c-4a70-b0a6-aeb92ebba253 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.845199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5150-7d4c-4a70-b0a6-aeb92ebba253 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.845555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5150-7d4c-4a70-b0a6-aeb92ebba253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.864927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-199a5150-7d4c-4a70-b0a6-aeb92ebba253 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:46.866168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-199a5150-7d4c-4a70-b0a6-aeb92ebba253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:46.869937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:46.909918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6606-e055-4937-8322-d37cc274a163 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:46.947131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 453/892] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:46.955835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:46.956906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:46.957315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:46.957731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:46.968947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:46.971227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:46.971376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5150-7d4c-4a70-b0a6-aeb92ebba253 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:46.989334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:46.990539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:46.991673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:46.993952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 440/893] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:49:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:47.000793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.094072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5150-7d4c-4a70-b0a6-aeb92ebba253 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.108962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.123452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d40b8c-5771-4324-84e8-08621b41cd4c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.137706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.138730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.138930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.139205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.139949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.141225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:47.153132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:47.154477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:47.155427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 454/894] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:47.161132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.167115 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.179887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.180820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.181103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.181378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.182728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:47.183045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.185092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.210234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 441/895] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 3 12:49:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:47.215644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.283275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5c76b-b9bb-4972-92be-a326787a7dbd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.325844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dcc4c-95b5-4150-b956-e1dae4fba3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.326729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dcc4c-95b5-4150-b956-e1dae4fba3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.327019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dcc4c-95b5-4150-b956-e1dae4fba3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.327289 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dcc4c-95b5-4150-b956-e1dae4fba3b6 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.327995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dcc4c-95b5-4150-b956-e1dae4fba3b6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:47.328302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dcc4c-95b5-4150-b956-e1dae4fba3b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.329671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dcc4c-95b5-4150-b956-e1dae4fba3b6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.339412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 455/896] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:47.339592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ce42-b56c-4da7-bee7-981df6ecb618 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.339679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aa424-bb07-4d00-b3b1-2361a237aef0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.339679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aa424-bb07-4d00-b3b1-2361a237aef0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.339679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aa424-bb07-4d00-b3b1-2361a237aef0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.339679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 456/897] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:47.340975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aa424-bb07-4d00-b3b1-2361a237aef0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.376301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.376971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.377256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.377530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.397418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.411850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.447582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aa424-bb07-4d00-b3b1-2361a237aef0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.450460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.452170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.483524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83054378-4483-49a6-9e42-30ab14070065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.484122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054378-4483-49a6-9e42-30ab14070065 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.484410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054378-4483-49a6-9e42-30ab14070065 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.484686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054378-4483-49a6-9e42-30ab14070065 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.485390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83054378-4483-49a6-9e42-30ab14070065 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:47.485696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83054378-4483-49a6-9e42-30ab14070065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.487094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83054378-4483-49a6-9e42-30ab14070065 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.496686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 457/898] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:47.496686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dde714-8fe9-4397-90a7-54941415a3d3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.496686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dde714-8fe9-4397-90a7-54941415a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.496686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dde714-8fe9-4397-90a7-54941415a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.510368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e8dde714-8fe9-4397-90a7-54941415a3d3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:47.511562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e8dde714-8fe9-4397-90a7-54941415a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:47.564853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 442/899] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 12:49:47.565980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.592832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 458/900] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:47.593692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dde714-8fe9-4397-90a7-54941415a3d3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.632595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.660760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.688764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71627d0a-d92d-445c-a539-a4934185b43e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.701095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dde714-8fe9-4397-90a7-54941415a3d3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.725218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.725883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.726193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.726472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.727377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] RBAC: Adding query filter params (interface=public, service_id=feaa19cea966457e92098707da873084, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:47.727789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.729256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.739348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 443/901] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/endpoints?service_id=feaa19cea966457e92098707da873084&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:47.739492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.739606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.739696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.739696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.739696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.750785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.752382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:47.770251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:47.771156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:47.772039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:47.772039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:47.772039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:47.772039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:47.772039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 459/902] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:47.772333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.848332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ca27d-650d-49da-bc80-9b847b668cfc None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.863068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.884824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28a29-570b-4d83-9734-67e7a0a6e718 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:47.888999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.889834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.890144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.890430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.891089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.892480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.900120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:47.906838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:47.907773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:47.908623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 444/903] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:47.909486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:47.928495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:47.929399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:47.929603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:47.929834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:47.930552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:47.932250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:47.946260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 460/904] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:49:47.946260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:48.044116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524d81-3e4f-40d9-8e07-3fc10db793f7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.068779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77925-e273-449b-91e7-30391fb79d92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.083044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.083730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.084014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.084288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.085021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:48.085332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.086775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.105448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 445/905] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:48.106487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:48.109997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.110835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.111218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.111594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.112441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:48.112856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.114491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.120653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 461/906] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:48.127312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:48.162668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:48.175612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:48.243127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5c04d-7898-4d25-9b5f-0e916c386c1c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.246337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b065-5413-43e9-b756-0121bf1314db None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.283519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.284512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.284804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.285083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.286385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:48.286755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.288081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.290934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.292123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.292512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.292889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.298775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 462/907] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:48.299964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:48.305638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.307264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:48.326560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:48.327573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:48.328473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:48.328905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 446/908] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:48.334566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:48.427908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957ffe6-62af-4d27-bee1-12754c5d1cd6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.435535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:48.466617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:48.471049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.471742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.472031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.472309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.472549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acefaad-3aba-4122-87e6-515d7bf40698 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.473109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] RBAC: Adding query filter params (interface=public, service_id=a03532e39d0d4a1997acb464e72baf1f, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:48.473423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.475843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.482216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 463/909] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:49:48 2022] GET /identity/v3/endpoints?service_id=a03532e39d0d4a1997acb464e72baf1f&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:48.488451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:48.525524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.526626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.527348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.528696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.536638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:48.537659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.542677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.567395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 447/910] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:48.571035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:48.619894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578767-a4a9-4d3d-9db4-96a02fbd5fcf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.667288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a41e26-cefc-4c0b-b5e4-587fec8957dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.667998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a41e26-cefc-4c0b-b5e4-587fec8957dd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.668335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a41e26-cefc-4c0b-b5e4-587fec8957dd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.668661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a41e26-cefc-4c0b-b5e4-587fec8957dd None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.669374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a41e26-cefc-4c0b-b5e4-587fec8957dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.671143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a41e26-cefc-4c0b-b5e4-587fec8957dd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.682689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c5a12-18d1-4b2f-be3e-35b5d81617d1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:48.683834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 464/911] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:49:48 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:49:48.726135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3dafa-197d-432c-824f-3248b65897b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:48.727225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3dafa-197d-432c-824f-3248b65897b6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:48.727735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3dafa-197d-432c-824f-3248b65897b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:48.728209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3dafa-197d-432c-824f-3248b65897b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:48.729256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3dafa-197d-432c-824f-3248b65897b6 None admin] RBAC: Adding query filter params (role.id=5ca6c7162c8f4ec4bb938167d0a76187, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=f7c40f2412c44324a20912e7564311ef) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:48.729772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3dafa-197d-432c-824f-3248b65897b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:48.731495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3dafa-197d-432c-824f-3248b65897b6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:48.739041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 448/912] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:48 2022] GET /identity/v3/role_assignments?user.id=f7c40f2412c44324a20912e7564311ef&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=5ca6c7162c8f4ec4bb938167d0a76187 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:49.123437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7520c2-b685-4725-9477-93c6bf14ec70 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:49.124444 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7520c2-b685-4725-9477-93c6bf14ec70 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:49.124444 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7520c2-b685-4725-9477-93c6bf14ec70 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:49.125835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 465/913] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:49.131708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b07fc-5462-468a-9791-3212a495c7f3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:49.132272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b07fc-5462-468a-9791-3212a495c7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:49.132272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b07fc-5462-468a-9791-3212a495c7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:49.151373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ca6b07fc-5462-468a-9791-3212a495c7f3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:49.152579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ca6b07fc-5462-468a-9791-3212a495c7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:49.172035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:49.230213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 449/914] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:49.249877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7520c2-b685-4725-9477-93c6bf14ec70 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:49.288364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:49.356422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7520c2-b685-4725-9477-93c6bf14ec70 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:49.391681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:49.392844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:49.393325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:49.393810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:49.394680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:49.396248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:49.408521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:49.409501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:49.410372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:49.413160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 466/915] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:49.419197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b07fc-5462-468a-9791-3212a495c7f3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:49.524190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b07fc-5462-468a-9791-3212a495c7f3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:49.560303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:49.561156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:49.561254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:49.561511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:49.562267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:49.562581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:49.563982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:49.574006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 450/916] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:49.579304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:49.682577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:49.685286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2330d-6248-4592-b78b-7f5bb035aa82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:49.721782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:49.722484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:49.722769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:49.723047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:49.723763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:49.724061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:49.725430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:49.730686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 467/917] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:49.736584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:49.755605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:49.839195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90031-6423-4bc9-b62d-7b4b557107ad None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:49.877419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907beb9-536b-47db-b8d3-b4bb9058474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:49.878095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907beb9-536b-47db-b8d3-b4bb9058474d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:49.878411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907beb9-536b-47db-b8d3-b4bb9058474d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:49.878691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907beb9-536b-47db-b8d3-b4bb9058474d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:49.879490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907beb9-536b-47db-b8d3-b4bb9058474d None admin] RBAC: Adding query filter params (interface=public, service_id=924a3837c0444923b2a5582b209235d6, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:49.879811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907beb9-536b-47db-b8d3-b4bb9058474d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:49.881199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907beb9-536b-47db-b8d3-b4bb9058474d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:49.891493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 451/918] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:49:49 2022] GET /identity/v3/endpoints?service_id=924a3837c0444923b2a5582b209235d6&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:49.892877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:50.002815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1de66c-bfca-4cda-9c7a-45028dd334bd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:50.039628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2345-e941-4e8a-a0b9-2a275bed4887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:50.040297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2345-e941-4e8a-a0b9-2a275bed4887 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:50.040639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2345-e941-4e8a-a0b9-2a275bed4887 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:50.040919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2345-e941-4e8a-a0b9-2a275bed4887 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:50.041608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2345-e941-4e8a-a0b9-2a275bed4887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:50.043007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2345-e941-4e8a-a0b9-2a275bed4887 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:50.054253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 468/919] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:49:49 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:49:50.322714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5d34-116b-4af0-887a-db15c82e54a0 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:50.323704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5d34-116b-4af0-887a-db15c82e54a0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:50.324200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5d34-116b-4af0-887a-db15c82e54a0 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:50.326101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 452/920] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:50.331649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c42f-6f92-4202-889d-0041dbdb66a6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:50.332494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c42f-6f92-4202-889d-0041dbdb66a6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:50.332972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c42f-6f92-4202-889d-0041dbdb66a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:50.350085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ffc4c42f-6f92-4202-889d-0041dbdb66a6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:50.351635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffc4c42f-6f92-4202-889d-0041dbdb66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:50.373284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:50.427379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 469/921] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:50.450368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea5d34-116b-4af0-887a-db15c82e54a0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:50.538032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:50.559333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea5d34-116b-4af0-887a-db15c82e54a0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:50.597301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:50.598029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:50.598338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:50.598615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:50.599271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:50.600654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:50.613350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:50.614381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:50.615229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 453/922] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:50.622300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c42f-6f92-4202-889d-0041dbdb66a6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:50.724073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c42f-6f92-4202-889d-0041dbdb66a6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:50.762762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:50.763489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:50.763776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:50.764055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:50.764785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:50.765099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:50.766545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:50.772576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 470/923] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:50.778590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:50.891152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94f2ee-e8c7-4319-842a-7af1a41df24c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:50.927087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fa8e2-56c3-4472-ad09-a250a24ff1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:50.928159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa8e2-56c3-4472-ad09-a250a24ff1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:50.928646 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa8e2-56c3-4472-ad09-a250a24ff1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:50.929143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa8e2-56c3-4472-ad09-a250a24ff1a7 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:50.930133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fa8e2-56c3-4472-ad09-a250a24ff1a7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:50.930670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fa8e2-56c3-4472-ad09-a250a24ff1a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:50.932249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fa8e2-56c3-4472-ad09-a250a24ff1a7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:50.938262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 454/924] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 3 12:49:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:50.944201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:50.966531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:51.046533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fb8c1-82c1-4e0d-acb7-702b5f379ebe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.085449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6074a-6c95-49b0-8e90-8f1a72b28d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.086134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6074a-6c95-49b0-8e90-8f1a72b28d8f None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.086434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6074a-6c95-49b0-8e90-8f1a72b28d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.086715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6074a-6c95-49b0-8e90-8f1a72b28d8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.087473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6074a-6c95-49b0-8e90-8f1a72b28d8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:51.088856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6074a-6c95-49b0-8e90-8f1a72b28d8f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:51.115271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559893f2-abd9-465b-be1b-07426aff0eb7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.115579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 471/925] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:49:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:51.115709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559893f2-abd9-465b-be1b-07426aff0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.115836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559893f2-abd9-465b-be1b-07426aff0eb7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.117454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 455/926] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:51.124493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4270-98b8-4051-8d0f-97ff35e2c7ce None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.125122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4270-98b8-4051-8d0f-97ff35e2c7ce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.125678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4270-98b8-4051-8d0f-97ff35e2c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.151509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3efa4270-98b8-4051-8d0f-97ff35e2c7ce None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:51.153201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3efa4270-98b8-4051-8d0f-97ff35e2c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:51.172474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012d23-815b-40df-8cb5-42d899d5bc20 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.172805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012d23-815b-40df-8cb5-42d899d5bc20 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.173033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012d23-815b-40df-8cb5-42d899d5bc20 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.174955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 456/927] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:49:51.180256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6748b-5acf-43c4-95aa-dd893c2504cf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.180588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6748b-5acf-43c4-95aa-dd893c2504cf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.180820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6748b-5acf-43c4-95aa-dd893c2504cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.202579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3ad6748b-5acf-43c4-95aa-dd893c2504cf None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:51.204474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3ad6748b-5acf-43c4-95aa-dd893c2504cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:51.207410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:51.245459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 472/928] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:51.269910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4270-98b8-4051-8d0f-97ff35e2c7ce None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.274488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:51.293481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 457/929] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:51.319002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6748b-5acf-43c4-95aa-dd893c2504cf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.382489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4270-98b8-4051-8d0f-97ff35e2c7ce None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.428155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.429437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.429940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.430452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.431305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:51.433074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:51.442040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6748b-5acf-43c4-95aa-dd893c2504cf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:51.447818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:51.448723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 12:49:51.449574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:51.453282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 473/930] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Jun 3 12:49:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:51.459883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.483197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.484513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.485022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.485514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.492946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:51.499886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:51.508440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:51.509376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:49:51.510664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:51.513062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 458/931] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 3 12:49:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:51.519689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.564474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f3db-19dd-41e8-afbb-6238874aec5d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.572186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:51.600643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.601306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.601593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.601872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.602620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:51.602931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:51.604312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:51.614342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 474/932] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:51.615235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.646685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3537-4211-4040-9e96-8eaebc164e5a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.685062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.686892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.687386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.687863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.688814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:51.689344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:51.690982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:51.706309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 459/933] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 3 12:49:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:51.707658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.717557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66e3c-2fb1-4cbb-9ed7-2f18e099c935 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.760099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:51.770836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.771852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.772903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.773384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.774667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:51.775446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:51.777720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:51.779926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:51.789050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 475/934] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:51.794147 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.836087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048bec5-93a6-40ef-9070-d37547332b43 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.876437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.877254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.877540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.877809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.890171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:51.891655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:51.900152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6706fe6-2342-4f6e-a0b7-36e8f63ebe92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:51.910229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:51.911205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:51.912206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:51.912206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:51.912206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:51.912206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:51.916244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 460/935] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:51.917275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:51.937394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:51.938011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:51.938388 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:51.938668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:51.939413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:51.940796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:51.970197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 476/936] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:49:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:49:52.050254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30cfb-e0ac-4e89-ac72-e32103918d36 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.067691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:52.103255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.103941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.104227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.104507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.105246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:52.105556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.107088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.121424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 461/937] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:52.128030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.184415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:52.244560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672ce96-adfc-4d77-ac41-0a8b651ae543 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.283018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282d0e-aaa9-4e90-9247-1ec5b6971057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.283853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282d0e-aaa9-4e90-9247-1ec5b6971057 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.284134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282d0e-aaa9-4e90-9247-1ec5b6971057 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.284429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282d0e-aaa9-4e90-9247-1ec5b6971057 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.292375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282d0e-aaa9-4e90-9247-1ec5b6971057 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.293832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282d0e-aaa9-4e90-9247-1ec5b6971057 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-36282d0e-aaa9-4e90-9247-1ec5b6971057 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:52.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:52.311778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:52.314000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 477/938] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:52.319490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.387051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0fe5f-4ceb-424e-8854-52ddbeec9e51 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.387873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0fe5f-4ceb-424e-8854-52ddbeec9e51 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.387873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0fe5f-4ceb-424e-8854-52ddbeec9e51 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.393047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 478/939] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:49:52.394613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9f1f6-2259-4c79-8173-705083ea330c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.394970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9f1f6-2259-4c79-8173-705083ea330c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.395320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9f1f6-2259-4c79-8173-705083ea330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.413466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-08c9f1f6-2259-4c79-8173-705083ea330c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:52.414782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08c9f1f6-2259-4c79-8173-705083ea330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:52.432296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d253a-3f8c-4e1c-9281-a18847e44d3d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.470203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.471639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.472106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.472687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.473826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:52.474387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.476145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.490342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 479/940] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:52.503804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 462/941] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:52.508738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9f1f6-2259-4c79-8173-705083ea330c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.515340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.550746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:52.558790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:52.608352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9f1f6-2259-4c79-8173-705083ea330c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.636397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6753-8caa-4a56-8e61-043dac3412c8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.642717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.643528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.643808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.644077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.644723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.646212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:52.659095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:52.660130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:52.660957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:52.665412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 480/942] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:52.666796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.677402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.678704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.679191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.679665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.692075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.694054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:52.713396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:52.714365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:52.715289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:52.715289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:52.715289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:52.715289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:52.722248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 463/943] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:52.723492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.770081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5b82-f3f0-4528-926b-f673e9f056d3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.772551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:52.808625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.809572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:52.809690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.809889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.810879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.811455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:52.811766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.813136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.823714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 481/944] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:52.825077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.835831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d9a58-29d3-4592-8823-3713caa953b9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.873835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.875007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.875496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.875996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.877020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:52.877575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.879183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.893360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 464/945] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:52.898751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:52.929220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3092fa-12bc-4222-9b5c-38a575f0a2b1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:52.964952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:52.965623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:52.965903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:52.966201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:52.966996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:52.967395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:52.968766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:52.978767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 482/946] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:52.980149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:53.007375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a2e-ccfd-43e8-a058-f48ad72b5c8c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:53.014613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:53.047113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:53.048346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:53.048962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:53.049551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:53.057248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:53.059170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:53.061279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:53.077595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:53.078575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:53.079472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.086288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc697a-e71f-49e5-8f57-639fa311bf97 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:53.086884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 465/947] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:53.087991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:53.124599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:53.125551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:53.125838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:53.126298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:53.127355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:53.129045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:53.155517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 483/948] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:49:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:53.223282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4951e-e6ce-4191-975f-1e9c47c80fbe None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:53.272613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc530c98-3ca4-4443-890f-4cb12b8373d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:53.273310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530c98-3ca4-4443-890f-4cb12b8373d0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:53.273640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530c98-3ca4-4443-890f-4cb12b8373d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:53.273917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530c98-3ca4-4443-890f-4cb12b8373d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:53.274786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530c98-3ca4-4443-890f-4cb12b8373d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:53.275095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530c98-3ca4-4443-890f-4cb12b8373d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:53.276597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530c98-3ca4-4443-890f-4cb12b8373d0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:53.291860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 466/949] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:53.298078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:53.401287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:53.415280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fc7-d897-45c6-a0f1-7ca02f7947c5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:53.451750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe738-c710-4e68-b557-8bf8116b8f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:53.452571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe738-c710-4e68-b557-8bf8116b8f66 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:53.452855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe738-c710-4e68-b557-8bf8116b8f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:53.453130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe738-c710-4e68-b557-8bf8116b8f66 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/f7c40f2412c44324a20912e7564311ef/roles/5ca6c7162c8f4ec4bb938167d0a76187` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:53.455486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe738-c710-4e68-b557-8bf8116b8f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=f7c40f2412c44324a20912e7564311ef, role_id=5ca6c7162c8f4ec4bb938167d0a76187)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:53.456963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe738-c710-4e68-b557-8bf8116b8f66 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:53.474028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 484/950] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:49:53 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/f7c40f2412c44324a20912e7564311ef/roles/5ca6c7162c8f4ec4bb938167d0a76187 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:49:53.642917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838355ed-e45b-4377-bd79-5a0475e3590e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:53.643458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838355ed-e45b-4377-bd79-5a0475e3590e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:53.643458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838355ed-e45b-4377-bd79-5a0475e3590e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:53.645097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 467/951] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:53.650983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1742d4-1257-43d1-aae3-640c4d89e90c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:53.651272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1742d4-1257-43d1-aae3-640c4d89e90c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:53.651546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1742d4-1257-43d1-aae3-640c4d89e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:53.674594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cd1742d4-1257-43d1-aae3-640c4d89e90c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:53.675824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cd1742d4-1257-43d1-aae3-640c4d89e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:53.749853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 485/952] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:53.773243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838355ed-e45b-4377-bd79-5a0475e3590e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:53.833553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:53.881660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838355ed-e45b-4377-bd79-5a0475e3590e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:53.916154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:53.916738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:53.917017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:53.917292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:53.918010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:53.919479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:53.921444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING keystone.server.flask.common [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 12:49:53.941555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.sql.core [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 12:49:53.941555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 12:49:53.941555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [parameters: {'id': 'b6d5b58e108045c0bfbd7fdb672eda69', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 12:49:53.941555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80235) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b6d5b58e108045c0bfbd7fdb672eda69.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b6d5b58e108045c0bfbd7fdb672eda69. Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application conn.query(q) Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 12:49:53.949764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result.read() Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 03 12:49:53.950595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application next(self.gen) Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application yield resource Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application next(self.gen) Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise self.value Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application session.commit() Jun 03 12:49:53.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.session.flush() Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application compat.raise_( Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 12:49:53.952624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 12:49:53.953529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application conn.query(q) Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result.read() Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 12:49:53.954465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [parameters: {'id': 'b6d5b58e108045c0bfbd7fdb672eda69', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:53.955908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:53.957554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b6d5b58e108045c0bfbd7fdb672eda69. Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:53.959964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 468/953] 10.222.0.58 () {60 vars in 1140 bytes} [Fri Jun 3 12:49:53 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:53.962527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1742d4-1257-43d1-aae3-640c4d89e90c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:54.044520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:54.071322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1742d4-1257-43d1-aae3-640c4d89e90c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:54.108621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13dcb5-3d4c-4af6-b258-4401c679ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:54.109675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13dcb5-3d4c-4af6-b258-4401c679ee31 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:54.110146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13dcb5-3d4c-4af6-b258-4401c679ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:54.110564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13dcb5-3d4c-4af6-b258-4401c679ee31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:54.117692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13dcb5-3d4c-4af6-b258-4401c679ee31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:54.119373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13dcb5-3d4c-4af6-b258-4401c679ee31 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4e13dcb5-3d4c-4af6-b258-4401c679ee31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:54.133878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:54.135026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:54.136199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:54.142472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 486/954] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:54.144733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:54.246366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80ed08-e6ac-4119-be18-a58f962100b6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:54.258132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:54.283066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb2632-2d02-46f0-be30-72e9db1eb934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:54.283735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2632-2d02-46f0-be30-72e9db1eb934 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:54.284057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2632-2d02-46f0-be30-72e9db1eb934 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:54.284435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2632-2d02-46f0-be30-72e9db1eb934 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:54.285206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb2632-2d02-46f0-be30-72e9db1eb934 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:54.285510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb2632-2d02-46f0-be30-72e9db1eb934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:54.287185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb2632-2d02-46f0-be30-72e9db1eb934 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:54.312431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 469/955] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:54.392419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde080f7-9f6d-464e-99bc-c989fdd1c71c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:54.392688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde080f7-9f6d-464e-99bc-c989fdd1c71c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:54.392968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde080f7-9f6d-464e-99bc-c989fdd1c71c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:54.394776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 487/956] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:54.404526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805256-3492-475b-bb54-b731d89604b4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:54.404878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805256-3492-475b-bb54-b731d89604b4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:54.405105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805256-3492-475b-bb54-b731d89604b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:54.424036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b0805256-3492-475b-bb54-b731d89604b4 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:54.425693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b0805256-3492-475b-bb54-b731d89604b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:54.511282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 470/957] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:54.533538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde080f7-9f6d-464e-99bc-c989fdd1c71c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:54.651277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde080f7-9f6d-464e-99bc-c989fdd1c71c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:54.688393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:54.689231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:54.689515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:54.689792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:54.690490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:54.691900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:54.705037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:54.706200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:54.707267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 488/958] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:54.716522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805256-3492-475b-bb54-b731d89604b4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:54.815464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:54.818387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805256-3492-475b-bb54-b731d89604b4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:54.855947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8a6f8-c865-4f70-8901-2a43945c272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:54.856629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a6f8-c865-4f70-8901-2a43945c272f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:54.856918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a6f8-c865-4f70-8901-2a43945c272f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:54.857416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a6f8-c865-4f70-8901-2a43945c272f None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:54.858042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a6f8-c865-4f70-8901-2a43945c272f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:54.858382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a6f8-c865-4f70-8901-2a43945c272f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:54.859828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a6f8-c865-4f70-8901-2a43945c272f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:54.865477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 471/959] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:54.871262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:54.882455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:54.978448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f730e-6040-4887-bd11-40c34136ffc6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:55.014913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f19bf7-af7e-496b-9552-63cd9067f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:55.015970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19bf7-af7e-496b-9552-63cd9067f025 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:55.016455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19bf7-af7e-496b-9552-63cd9067f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:55.016928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19bf7-af7e-496b-9552-63cd9067f025 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:55.017832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f19bf7-af7e-496b-9552-63cd9067f025 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:55.018429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f19bf7-af7e-496b-9552-63cd9067f025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:55.020007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f19bf7-af7e-496b-9552-63cd9067f025 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:55.030231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 489/960] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:49:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:55.578490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f000-b7be-49f5-b20c-2247b2584682 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:55.578884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f000-b7be-49f5-b20c-2247b2584682 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:55.579053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f000-b7be-49f5-b20c-2247b2584682 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:55.580831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 472/961] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:55.586710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34187e57-e5ef-4853-a396-c5d63f663020 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:55.587207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34187e57-e5ef-4853-a396-c5d63f663020 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:55.587284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34187e57-e5ef-4853-a396-c5d63f663020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:55.605053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-34187e57-e5ef-4853-a396-c5d63f663020 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:55.606691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34187e57-e5ef-4853-a396-c5d63f663020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:55.671193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:55.679188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 490/962] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:55.701799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f000-b7be-49f5-b20c-2247b2584682 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:55.812967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f000-b7be-49f5-b20c-2247b2584682 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:55.848094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:55.848910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:55.849194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:55.849472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:55.850148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:55.851547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:55.855850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2400af-f953-46fd-84b0-6db22dd422ef None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:55.856136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2400af-f953-46fd-84b0-6db22dd422ef None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:55.856409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2400af-f953-46fd-84b0-6db22dd422ef None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:55.858419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 491/963] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:55.863244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105317-de43-4e4e-a7ec-2d8c1148996e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:55.863529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105317-de43-4e4e-a7ec-2d8c1148996e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:55.863804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105317-de43-4e4e-a7ec-2d8c1148996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:55.864089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:55.865060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:55.865908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 473/964] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:55.871047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:55.886860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dd105317-de43-4e4e-a7ec-2d8c1148996e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:55.888234 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd105317-de43-4e4e-a7ec-2d8c1148996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:55.901792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:55.970538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 492/965] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:49:55.997951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e12e5-3fc2-4113-8b0e-f96d749c2760 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:55.999220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd105317-de43-4e4e-a7ec-2d8c1148996e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.039161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.040093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.040375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.040650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.041356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:56.041887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.044178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.054526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 474/966] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:49:56.055404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.121134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd105317-de43-4e4e-a7ec-2d8c1148996e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.157310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:56.167212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:56.175351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.177196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.177912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.178404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.180765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756ced8-88f2-4731-b1b6-ba1a8c04fdff None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.194422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:49:56.205875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:56.207077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:49:56.207908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:56.211270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 493/967] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 3 12:49:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:56.216730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.227697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.228381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.228667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.228943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.229661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:56.229971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.231416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.237908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 475/968] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:56.244126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.334700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9459abc-0638-4977-9ee0-a30ca8b72070 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.366807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26319c30-049c-49ea-ae56-6f8b43085f9b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.370142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.370380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.370621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.370864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.371665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:56.371916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.373655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.382907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 494/969] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 3 12:49:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:56.388167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.413849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.414978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.415484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.415962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.417090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] RBAC: Adding query filter params (interface=admin, service_id=924a3837c0444923b2a5582b209235d6, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:56.417627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.419314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.431357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 476/970] 10.222.0.58 () {56 vars in 1249 bytes} [Fri Jun 3 12:49:56 2022] GET /identity/v3/endpoints?service_id=924a3837c0444923b2a5582b209235d6&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:56.432675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.456026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:56.457439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:56.514553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d92de3-ff61-4909-95e8-f23887c12b1d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.538189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce214-a050-4576-8dde-bc32d46da1c9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.556685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.557598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.557891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.558240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.570470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.571798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.575568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b37198-4f9c-46c0-835a-6fc1114e3e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.576585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b37198-4f9c-46c0-835a-6fc1114e3e38 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.577068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b37198-4f9c-46c0-835a-6fc1114e3e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.577537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b37198-4f9c-46c0-835a-6fc1114e3e38 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.578457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b37198-4f9c-46c0-835a-6fc1114e3e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.580132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b37198-4f9c-46c0-835a-6fc1114e3e38 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:56.591853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:56.593074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:56.593988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:56.593988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:56.593988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:56.593988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:56.596477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 495/971] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:56.597353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.606607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 477/972] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:49:56 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:49:56.713184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:56.716689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24e61-d497-4320-853f-59db6d953ecf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.751081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042870-4b0c-4586-a617-a39b5e8eb2ce None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.751923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042870-4b0c-4586-a617-a39b5e8eb2ce None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.752524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042870-4b0c-4586-a617-a39b5e8eb2ce None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.754608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 478/973] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:56.754828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.755509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.755798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.756079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.756814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:56.757126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.758545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.759887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfab6-7591-47fe-b048-5cd1a303a9da None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.760410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfab6-7591-47fe-b048-5cd1a303a9da None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.760891 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfab6-7591-47fe-b048-5cd1a303a9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.772728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 496/974] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:56.778590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.782069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-036dfab6-7591-47fe-b048-5cd1a303a9da None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:56.783640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-036dfab6-7591-47fe-b048-5cd1a303a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:56.866632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 479/975] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:56.893906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfab6-7591-47fe-b048-5cd1a303a9da None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:56.904815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37bde-d20a-41ee-9606-9b43a80039d2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:56.908528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:56.954401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:56.956062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:56.956501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:56.956928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:56.967684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:56.969465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:56.990585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:56.991799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 12:49:56.993003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:57.001945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 497/976] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:49:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:49:57.003893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:57.007557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfab6-7591-47fe-b048-5cd1a303a9da None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:57.033709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:57.047632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:57.048323 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.048608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.048936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.049601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:57.051098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:57.066275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.sql.core [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 12:49:57.066275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 12:49:57.066275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [parameters: {'user_id': '4eebc7c3c7224db7972583e6d91260df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 12:49:57.066275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80235) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application conn.query(q) Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result.read() Jun 03 12:49:57.076306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 12:49:57.077239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application next(self.gen) Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application yield resource Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application next(self.gen) Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise self.value Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application session.commit() Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 12:49:57.078228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.session.flush() Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application compat.raise_( Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 12:49:57.079171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 12:49:57.080123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application conn.query(q) Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application result.read() Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 12:49:57.082819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [parameters: {'user_id': '4eebc7c3c7224db7972583e6d91260df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:57.084789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 03 12:49:57.086770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 480/977] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 3 12:49:56 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:57.089708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:57.139450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b07ad-7599-4d2a-bdf6-1d5b2cacf0d7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:57.176316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:57.177439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.177963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.178480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.179772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:57.180300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:57.182068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:57.188901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:57.211515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 498/978] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 3 12:49:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:57.212777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:57.220436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fe5bb-a2f1-481d-b466-e0ea877df5e2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:57.267530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:57.268353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.268639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.268921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.279913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:57.282555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:49:57.299953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:57.301001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 12:49:57.301953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:57.304239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:57.306048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 481/979] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:49:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:57.307014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:57.333732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bb50a-880d-44a7-818b-fc52a655f3ab None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:57.371436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:57.372126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.372404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.372682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.420606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd321-1003-4989-9fef-fad169cef9dc None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:57.445075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:57.446595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:57.456712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f55ed-5872-4d0d-b440-676d003a67bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:57.457399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f55ed-5872-4d0d-b440-676d003a67bc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.457691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f55ed-5872-4d0d-b440-676d003a67bc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.457972 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f55ed-5872-4d0d-b440-676d003a67bc None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.458813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f55ed-5872-4d0d-b440-676d003a67bc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:57.459129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f55ed-5872-4d0d-b440-676d003a67bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:57.460553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f55ed-5872-4d0d-b440-676d003a67bc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:57.471095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:57.506268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 482/980] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 3 12:49:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:57.508072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5deef-e527-4a31-b27b-611b83f1cc30 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.508514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5deef-e527-4a31-b27b-611b83f1cc30 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.508932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5deef-e527-4a31-b27b-611b83f1cc30 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.516955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 483/981] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:57.519516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d36d-b52d-486f-9477-bdfeb01da070 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.520872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d36d-b52d-486f-9477-bdfeb01da070 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.521474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d36d-b52d-486f-9477-bdfeb01da070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.566144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:57.566897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0085d36d-b52d-486f-9477-bdfeb01da070 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:57.568201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0085d36d-b52d-486f-9477-bdfeb01da070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:57.624717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 499/982] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:49:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:49:57.628972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:57.740912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 484/983] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:57.766097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085d36d-b52d-486f-9477-bdfeb01da070 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:57.827711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62187ad-3295-4ea0-a53c-dc3350bca642 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:57.871021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:57.872135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.872612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.873088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.887394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085d36d-b52d-486f-9477-bdfeb01da070 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:57.888382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:57.890336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:49:57.914357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:57.915315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:57.916190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:49:57.916190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:49:57.916190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:49:57.916190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:57.917172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:57.918733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 500/984] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:57.927137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:57.930246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:57.931179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:57.931676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:57.932146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:57.933082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:57.934713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:57.966138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 485/985] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:49:57 2022] POST /identity/v3/services => generated 242 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:49:57.969137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:58.051989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b948cb-82df-4f76-8a6f-9b9ec049a19e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:58.098706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:58.099391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:58.099674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:58.099923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:58.100685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:58.100992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:58.102438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:58.115555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 501/986] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:58.121290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:58.231767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa062747-7626-449c-87fd-211e80a41205 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:58.267552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:58.268359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:58.268637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:58.268887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:58.276203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:58.277653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:49:58.293892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:58.295078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:49:58.295978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 486/987] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:58.302528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:58.391034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:58.406854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc34e7-c5a0-4dd8-bc47-83109a90d4ad None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:58.441608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08782c9-08e4-44c4-9cc6-ec652b9e4512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:58.442377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08782c9-08e4-44c4-9cc6-ec652b9e4512 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:58.442660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08782c9-08e4-44c4-9cc6-ec652b9e4512 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:58.442928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08782c9-08e4-44c4-9cc6-ec652b9e4512 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:58.443710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08782c9-08e4-44c4-9cc6-ec652b9e4512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:58.444014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08782c9-08e4-44c4-9cc6-ec652b9e4512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:58.445456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08782c9-08e4-44c4-9cc6-ec652b9e4512 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:58.458925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 502/988] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:58.464781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:58.516580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:58.584702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4457ab-118a-41b5-89b9-60dc17626ee3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:58.619968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637dbce-c929-404d-8628-19b896e02482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:58.620635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637dbce-c929-404d-8628-19b896e02482 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:58.620918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637dbce-c929-404d-8628-19b896e02482 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:58.621310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637dbce-c929-404d-8628-19b896e02482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:58.622189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637dbce-c929-404d-8628-19b896e02482 None admin] RBAC: Adding query filter params (role.id=5ca6c7162c8f4ec4bb938167d0a76187, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=f7c40f2412c44324a20912e7564311ef) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:58.622511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637dbce-c929-404d-8628-19b896e02482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:58.624456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637dbce-c929-404d-8628-19b896e02482 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:58.631769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 487/989] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:49:58 2022] GET /identity/v3/role_assignments?user.id=f7c40f2412c44324a20912e7564311ef&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=5ca6c7162c8f4ec4bb938167d0a76187 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:58.975108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efc248-1194-4468-a29e-1e335d2ffeeb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:58.975633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efc248-1194-4468-a29e-1e335d2ffeeb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:58.975633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efc248-1194-4468-a29e-1e335d2ffeeb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:58.977203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 503/990] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:49:58.982650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd634-a1da-4241-839a-6332acff6f42 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:58.983294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd634-a1da-4241-839a-6332acff6f42 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:58.983294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd634-a1da-4241-839a-6332acff6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:59.001167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-78ecd634-a1da-4241-839a-6332acff6f42 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:49:59.002400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-78ecd634-a1da-4241-839a-6332acff6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:49:59.077301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 488/991] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:49:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:49:59.100893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efc248-1194-4468-a29e-1e335d2ffeeb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:59.209508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efc248-1194-4468-a29e-1e335d2ffeeb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:59.245318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:59.246052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:59.246376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:59.246649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:59.247302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:59.249105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:49:59.261579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:49:59.262786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 12:49:59.263844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:49:59.268367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 504/992] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 3 12:49:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:49:59.269544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecd634-a1da-4241-839a-6332acff6f42 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:59.309731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:59.375805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecd634-a1da-4241-839a-6332acff6f42 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:59.411579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:59.412243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:59.412522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:59.412792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:59.413495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:59.413804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:59.415206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:59.420810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 489/993] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:59.427246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:59.441482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:59.540499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c6697-7689-46e8-a16a-2393fc5c1a27 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:59.576985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04801abc-aebf-4c59-b164-f32ad59549c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:59.577655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801abc-aebf-4c59-b164-f32ad59549c5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:59.577935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801abc-aebf-4c59-b164-f32ad59549c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:59.578247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801abc-aebf-4c59-b164-f32ad59549c5 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:59.578952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801abc-aebf-4c59-b164-f32ad59549c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:49:59.579258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801abc-aebf-4c59-b164-f32ad59549c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:59.580644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801abc-aebf-4c59-b164-f32ad59549c5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:59.585782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 505/994] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 3 12:49:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:49:59.591317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:49:59.710775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9202c-de44-4358-9797-69e2b71fc551 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:49:59.712375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:49:59.747366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820a4eb-7a02-4ed2-99ec-ad7c00ecb09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:49:59.748850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a4eb-7a02-4ed2-99ec-ad7c00ecb09e None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:49:59.748850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a4eb-7a02-4ed2-99ec-ad7c00ecb09e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:49:59.749066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a4eb-7a02-4ed2-99ec-ad7c00ecb09e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:49:59.749748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820a4eb-7a02-4ed2-99ec-ad7c00ecb09e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:49:59.751153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820a4eb-7a02-4ed2-99ec-ad7c00ecb09e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:49:59.774162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 490/995] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:49:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:00.262445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0b7b-e5a4-416a-acd2-78e0113dc376 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:00.263084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0b7b-e5a4-416a-acd2-78e0113dc376 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:00.263084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0b7b-e5a4-416a-acd2-78e0113dc376 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:00.264723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 506/996] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:00.270025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f978-9b1b-4bf3-a9ad-79f2f1d09fff None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:00.270469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f978-9b1b-4bf3-a9ad-79f2f1d09fff None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:00.270667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f978-9b1b-4bf3-a9ad-79f2f1d09fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:00.287561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bf24f978-9b1b-4bf3-a9ad-79f2f1d09fff None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:00.288759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bf24f978-9b1b-4bf3-a9ad-79f2f1d09fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:00.367574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 491/997] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:00.391071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0b7b-e5a4-416a-acd2-78e0113dc376 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:00.473560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:00.503521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0b7b-e5a4-416a-acd2-78e0113dc376 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:00.550671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:00.551483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:00.551766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:00.552031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:00.552683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:00.554051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:00.566615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:00.567815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:50:00.568654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:00.570243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 507/998] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:50:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:00.574023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24f978-9b1b-4bf3-a9ad-79f2f1d09fff None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:00.672542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:00.687242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24f978-9b1b-4bf3-a9ad-79f2f1d09fff None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:00.723102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:00.723771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:00.724053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:00.724326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:00.725025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:00.725330 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:00.726738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:00.731680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 492/999] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:50:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:00.737842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:00.844294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf07123-b720-4576-97c9-f9a15458f241 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:00.879887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cefa3-8304-490b-841e-4abf4879353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:00.880552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cefa3-8304-490b-841e-4abf4879353e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:00.880833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cefa3-8304-490b-841e-4abf4879353e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:00.881108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cefa3-8304-490b-841e-4abf4879353e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:00.881809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cefa3-8304-490b-841e-4abf4879353e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:00.882132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cefa3-8304-490b-841e-4abf4879353e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:00.883521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cefa3-8304-490b-841e-4abf4879353e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:00.888688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 508/1000] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:50:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:00.894610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:00.922200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed43d2b-602c-49d9-b958-015bc4b63195 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:00.922493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed43d2b-602c-49d9-b958-015bc4b63195 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:00.922775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed43d2b-602c-49d9-b958-015bc4b63195 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:00.924187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 509/1001] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:00.930248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b9ba-cbab-40f3-9515-cd72886a4b1d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:00.930567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b9ba-cbab-40f3-9515-cd72886a4b1d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:00.930808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b9ba-cbab-40f3-9515-cd72886a4b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:00.936957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:00.949853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9b58b9ba-cbab-40f3-9515-cd72886a4b1d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:00.951174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b58b9ba-cbab-40f3-9515-cd72886a4b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:01.006587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f9404-042a-4433-a1d5-589e124e9fc6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:01.022962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 510/1002] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:01.041456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:01.042145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:01.042434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:01.042716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:01.043509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] RBAC: Adding query filter params (interface=public, service_id=a2817ac3c00d473683bae5d901cdfcdd, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:01.043910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:01.045093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58b9ba-cbab-40f3-9515-cd72886a4b1d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:01.045324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:01.051805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 493/1003] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:50:00 2022] GET /identity/v3/endpoints?service_id=a2817ac3c00d473683bae5d901cdfcdd&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:01.057075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:01.075354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:01.150188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58b9ba-cbab-40f3-9515-cd72886a4b1d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:01.158692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc98482-1a87-4de6-929e-488af00e9274 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:01.180419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:01.187738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:01.188816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:01.189104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:01.189627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:01.190696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:01.192551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:01.195029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:01.195705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:01.195994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:01.196276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:01.196962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:01.198357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:01.205134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 494/1004] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:50:01 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:01.205402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:01.211858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:01.212715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 511/1005] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Jun 3 12:50:01 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:01.215249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:01.305713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:01.328800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6dadc-a5a3-469b-b120-c5585edb6e97 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:01.366683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3ebe9-43a8-4e73-9dd9-0fda808a4232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:01.367376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3ebe9-43a8-4e73-9dd9-0fda808a4232 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:01.367660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3ebe9-43a8-4e73-9dd9-0fda808a4232 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:01.367976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3ebe9-43a8-4e73-9dd9-0fda808a4232 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:01.368662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3ebe9-43a8-4e73-9dd9-0fda808a4232 None admin] RBAC: Adding query filter params (name=image) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:01.368976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3ebe9-43a8-4e73-9dd9-0fda808a4232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:01.370427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3ebe9-43a8-4e73-9dd9-0fda808a4232 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:01.377000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 495/1006] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:01.382705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:01.493178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e991e0-13c8-42a4-a4e1-215ab65ef79a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:01.528615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f11fe-dde6-4b1b-88d0-2830b019f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:01.529394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f11fe-dde6-4b1b-88d0-2830b019f691 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:01.529751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f11fe-dde6-4b1b-88d0-2830b019f691 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:01.530033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f11fe-dde6-4b1b-88d0-2830b019f691 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:01.530776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f11fe-dde6-4b1b-88d0-2830b019f691 None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:01.531084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f11fe-dde6-4b1b-88d0-2830b019f691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:01.532472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f11fe-dde6-4b1b-88d0-2830b019f691 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:01.541578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 512/1007] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:02.096179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f018d-28c0-414b-9543-fd04b288cd52 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:02.096445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f018d-28c0-414b-9543-fd04b288cd52 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:02.096709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f018d-28c0-414b-9543-fd04b288cd52 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:02.098105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 496/1008] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:02.103815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60893d3d-a27c-46bc-8eb4-ba6b685f7908 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:02.104067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60893d3d-a27c-46bc-8eb4-ba6b685f7908 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:02.104347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60893d3d-a27c-46bc-8eb4-ba6b685f7908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:02.121632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-60893d3d-a27c-46bc-8eb4-ba6b685f7908 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:02.122844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-60893d3d-a27c-46bc-8eb4-ba6b685f7908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:02.182158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:02.194980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 513/1009] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:02.219822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f018d-28c0-414b-9543-fd04b288cd52 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:02.324778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f018d-28c0-414b-9543-fd04b288cd52 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:02.362756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845dc82-6693-45e6-9640-a38974d2da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:02.363452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845dc82-6693-45e6-9640-a38974d2da2a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:02.363752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845dc82-6693-45e6-9640-a38974d2da2a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:02.364025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845dc82-6693-45e6-9640-a38974d2da2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:02.365216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845dc82-6693-45e6-9640-a38974d2da2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:02.366704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845dc82-6693-45e6-9640-a38974d2da2a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:02.368502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 497/1010] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:02.374920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60893d3d-a27c-46bc-8eb4-ba6b685f7908 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:02.476665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60893d3d-a27c-46bc-8eb4-ba6b685f7908 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:02.514398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06634a-62a2-405a-b339-3aa8213bdc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:02.515066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06634a-62a2-405a-b339-3aa8213bdc37 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:02.515346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06634a-62a2-405a-b339-3aa8213bdc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:02.515619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06634a-62a2-405a-b339-3aa8213bdc37 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:02.516322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06634a-62a2-405a-b339-3aa8213bdc37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:02.517763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06634a-62a2-405a-b339-3aa8213bdc37 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:02.556198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 514/1011] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:50:02 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:50:03.492621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed0cf-de5b-4f2d-be32-bce7917067ce None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:03.493209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed0cf-de5b-4f2d-be32-bce7917067ce None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:03.493209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed0cf-de5b-4f2d-be32-bce7917067ce None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:03.494767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 498/1012] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:03.500312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51bf0-05ce-4f5a-85b4-72e74bca02a8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:03.500733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51bf0-05ce-4f5a-85b4-72e74bca02a8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:03.500906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51bf0-05ce-4f5a-85b4-72e74bca02a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:03.517813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-51a51bf0-05ce-4f5a-85b4-72e74bca02a8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:03.519023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-51a51bf0-05ce-4f5a-85b4-72e74bca02a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:03.562579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:03.596926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 515/1013] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:03.619808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ed0cf-de5b-4f2d-be32-bce7917067ce None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:03.635676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:03.728937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ed0cf-de5b-4f2d-be32-bce7917067ce None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:03.765134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:03.765841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:03.766139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:03.766443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:03.767112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:03.768488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:03.779538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3e46-42e1-474f-a07d-6b600e3eec19 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:03.779995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3e46-42e1-474f-a07d-6b600e3eec19 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:03.780424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3e46-42e1-474f-a07d-6b600e3eec19 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:03.780660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:03.781822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 12:50:03.782721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:03.783480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 516/1014] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:03.783561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 499/1015] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:50:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:03.788021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad333c-622a-45af-af91-7b9d0854c313 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:03.788021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad333c-622a-45af-af91-7b9d0854c313 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:03.788245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:03.788337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad333c-622a-45af-af91-7b9d0854c313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:03.805705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-20ad333c-622a-45af-af91-7b9d0854c313 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:03.807359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20ad333c-622a-45af-af91-7b9d0854c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:03.872257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:03.882143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 517/1016] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:03.898421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04648d-4d58-4a1f-b705-42b7b5bc7251 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:03.902613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad333c-622a-45af-af91-7b9d0854c313 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:03.933590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:03.934305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:03.934625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:03.934895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:03.935661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:03.935974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:03.937904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:03.942751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 500/1017] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:50:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:03.948122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:04.015532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad333c-622a-45af-af91-7b9d0854c313 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:04.017744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:04.049833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953ca1-6af3-4da9-9a4e-77a8a4e338a5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:04.055144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:04.055819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:04.056108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:04.056393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:04.057211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:04.058751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:04.078142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 518/1018] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:50:03 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:04.095126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb048f-a418-4944-a673-16b4ba4c4c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:04.095821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb048f-a418-4944-a673-16b4ba4c4c4d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:04.096108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb048f-a418-4944-a673-16b4ba4c4c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:04.096384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb048f-a418-4944-a673-16b4ba4c4c4d None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:04.097139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb048f-a418-4944-a673-16b4ba4c4c4d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:04.097452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb048f-a418-4944-a673-16b4ba4c4c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:04.098920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb048f-a418-4944-a673-16b4ba4c4c4d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:04.101944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:04.105798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 501/1019] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 3 12:50:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:04.111464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:04.221582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e46c0-ba14-469e-b8e0-c9d9969204a3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:04.262563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11720e2-ed55-4f08-91a1-6d3a39bc07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:04.263246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11720e2-ed55-4f08-91a1-6d3a39bc07d5 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:04.263531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11720e2-ed55-4f08-91a1-6d3a39bc07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:04.263837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11720e2-ed55-4f08-91a1-6d3a39bc07d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:04.264720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11720e2-ed55-4f08-91a1-6d3a39bc07d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:04.266187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11720e2-ed55-4f08-91a1-6d3a39bc07d5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:04.290252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 519/1020] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:50:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:50:04.851779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c83a-56dd-4103-b7f7-4baef9caab76 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:04.852300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c83a-56dd-4103-b7f7-4baef9caab76 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:04.852300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c83a-56dd-4103-b7f7-4baef9caab76 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:04.853596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 502/1021] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:04.859946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6184-53af-4d2f-8b50-0e4e8b7c47fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:04.860393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6184-53af-4d2f-8b50-0e4e8b7c47fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:04.860473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6184-53af-4d2f-8b50-0e4e8b7c47fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:04.878398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-01cd6184-53af-4d2f-8b50-0e4e8b7c47fa None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:04.879596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01cd6184-53af-4d2f-8b50-0e4e8b7c47fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:04.893732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:04.958721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 520/1022] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:50:04.984355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c83a-56dd-4103-b7f7-4baef9caab76 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:05.094493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c83a-56dd-4103-b7f7-4baef9caab76 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:05.131346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92812cc-68ae-4070-89ac-81ff584d9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:05.132109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92812cc-68ae-4070-89ac-81ff584d9884 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:05.132394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92812cc-68ae-4070-89ac-81ff584d9884 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:05.132669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92812cc-68ae-4070-89ac-81ff584d9884 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:05.133863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92812cc-68ae-4070-89ac-81ff584d9884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:05.135355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92812cc-68ae-4070-89ac-81ff584d9884 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:05.137160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 503/1023] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:05.143188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd6184-53af-4d2f-8b50-0e4e8b7c47fa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:05.246257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd6184-53af-4d2f-8b50-0e4e8b7c47fa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:05.283818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4472a-1eb9-406b-9d11-a85b571eda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:05.284497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4472a-1eb9-406b-9d11-a85b571eda75 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:05.284778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4472a-1eb9-406b-9d11-a85b571eda75 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:05.285055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4472a-1eb9-406b-9d11-a85b571eda75 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:05.285760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4472a-1eb9-406b-9d11-a85b571eda75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:05.287211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4472a-1eb9-406b-9d11-a85b571eda75 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:05.303591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:05.318222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 521/1024] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:50:05 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:06.357818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83824ee-0cb3-4e7d-baf2-9d7086db06f2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.358959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83824ee-0cb3-4e7d-baf2-9d7086db06f2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.358959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83824ee-0cb3-4e7d-baf2-9d7086db06f2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.359943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 504/1025] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:06.365033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c806f5-8462-488d-a679-52714d5f0b0c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.365413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c806f5-8462-488d-a679-52714d5f0b0c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.365591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c806f5-8462-488d-a679-52714d5f0b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.383197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-68c806f5-8462-488d-a679-52714d5f0b0c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:06.384391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-68c806f5-8462-488d-a679-52714d5f0b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:06.453673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 522/1026] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:06.476531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83824ee-0cb3-4e7d-baf2-9d7086db06f2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:06.557794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:06.594845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83824ee-0cb3-4e7d-baf2-9d7086db06f2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:06.632104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c236af-dd10-47bc-ab68-a02904eab1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:06.632899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c236af-dd10-47bc-ab68-a02904eab1ed None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.633188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c236af-dd10-47bc-ab68-a02904eab1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.633442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c236af-dd10-47bc-ab68-a02904eab1ed None admin] PATH_INFO: `/v3/services/image` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.634145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c236af-dd10-47bc-ab68-a02904eab1ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:06.635624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c236af-dd10-47bc-ab68-a02904eab1ed None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a5c236af-dd10-47bc-ab68-a02904eab1ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:06.648620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:06.649655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:06.655084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 505/1027] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Jun 3 12:50:06 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:06.658029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c806f5-8462-488d-a679-52714d5f0b0c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:06.663205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6222e2-5134-48c9-bb9a-92269992040b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.663455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6222e2-5134-48c9-bb9a-92269992040b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.663772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6222e2-5134-48c9-bb9a-92269992040b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.665298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 506/1028] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:50:06.670294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa23c-fecb-4acb-b0c4-0b1b6e3bdbed None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.670589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa23c-fecb-4acb-b0c4-0b1b6e3bdbed None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.670914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fa23c-fecb-4acb-b0c4-0b1b6e3bdbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.688767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fc1fa23c-fecb-4acb-b0c4-0b1b6e3bdbed None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:06.689974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fc1fa23c-fecb-4acb-b0c4-0b1b6e3bdbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:06.759438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 507/1029] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:50:06.768787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c806f5-8462-488d-a679-52714d5f0b0c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:06.783566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fa23c-fecb-4acb-b0c4-0b1b6e3bdbed None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:06.798509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:06.806509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:06.807192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.807750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.808033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.808994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:06.809685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:06.811390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:06.822645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 523/1030] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:06.823633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:06.848306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:06.887828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fa23c-fecb-4acb-b0c4-0b1b6e3bdbed None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:06.922167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:06.922981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.923267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.923547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.929241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440b8d-2ba5-4da5-8805-cd5d8d909de0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:06.934326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:06.942608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:06.943761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:06.946959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 508/1031] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 3 12:50:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:50:06.949668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:06.972374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:06.973208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:06.973549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:06.973833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:06.974605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:06.974920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:06.976305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:06.981406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 524/1032] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:06.987263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.048943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:07.055378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbf255-5609-407b-95b0-e58493dc6465 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.080949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:07.094135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.094846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.095129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.095229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8fbf-b75a-414f-834f-7c38702b147c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.095438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.096146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:07.096455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:07.097854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:07.106740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 509/1033] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 3 12:50:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:07.112164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.132384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.133068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.133358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.133635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.134469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] RBAC: Adding query filter params (interface=public, service_id=5ed128eabc7a4492a876f00645500dd1, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:07.134789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:07.136175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:07.141596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 525/1034] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:50:06 2022] GET /identity/v3/endpoints?service_id=5ed128eabc7a4492a876f00645500dd1&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:07.147357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.218345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ba7a-066e-4933-90da-4f63948d3e27 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.251298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173afb-a655-47a0-8ab9-a98e84039671 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.256861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.257848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.258305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.258888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.271063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:07.272533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:07.276252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:07.290525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:07.290794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:07.291653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:07.292563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:50:07.292563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:07.292563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:07.292563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:07.292796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.292796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.292796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.292796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:07.293930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:07.297159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 510/1035] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:07.298040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.313009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 526/1036] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:50:07.341732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:07.417554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d145d5c-67bb-48fd-ba5f-cd15a8caf48d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.454950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c48fd7-295e-4c2a-ad33-e2e42ce19181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.455643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48fd7-295e-4c2a-ad33-e2e42ce19181 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.455928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48fd7-295e-4c2a-ad33-e2e42ce19181 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.456204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48fd7-295e-4c2a-ad33-e2e42ce19181 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.456949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c48fd7-295e-4c2a-ad33-e2e42ce19181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:07.457261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c48fd7-295e-4c2a-ad33-e2e42ce19181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:07.458724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c48fd7-295e-4c2a-ad33-e2e42ce19181 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:07.472290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 511/1037] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:07.477910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.592866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16ab4-b066-4849-b397-bd6928856da0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.629652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.630560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.630846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.631122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.636795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3cde-61e8-4c59-8996-c55738886a97 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.637329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3cde-61e8-4c59-8996-c55738886a97 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.637848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3cde-61e8-4c59-8996-c55738886a97 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.639494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:07.640584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 512/1038] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:07.640971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:07.645721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a24ac-d3a8-48b0-943f-98fbef525361 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.646281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a24ac-d3a8-48b0-943f-98fbef525361 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.646779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a24ac-d3a8-48b0-943f-98fbef525361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:50:07.656626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:07.657632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:07.658675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 527/1039] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:07.663384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.668970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-069a24ac-d3a8-48b0-943f-98fbef525361 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:07.670510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-069a24ac-d3a8-48b0-943f-98fbef525361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:07.712994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:07.762546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 513/1040] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:07.771222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62dd1-8de5-4f0e-9d69-a38c7a9422cc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.775488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a24ac-d3a8-48b0-943f-98fbef525361 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.806302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.806975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.807254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.807525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.808352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:07.808657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:07.810087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:07.815137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:07.828777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 528/1041] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:07.834192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.901084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a24ac-d3a8-48b0-943f-98fbef525361 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.938362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.939073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.939370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.939642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:07.942431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f3296-145b-4f94-ba35-725615c8abe6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:07.945548 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:07.950154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:07.957687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:07.958720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:07.959574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 514/1042] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:07.965011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:07.981198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:07.981905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:07.982222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:07.982543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.059119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.061240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.062985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.075236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a0f3-edaf-47b7-8f42-ee7e11486450 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.111826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.112538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.112829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.113101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.113843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:08.114183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.115603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.124496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 515/1043] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:08.130139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.172072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 529/1044] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 12:50:08.177607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.180367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.240055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8bb88-29c1-4744-a395-a3253faf404e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.276444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.277329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.277609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.277881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] PATH_INFO: `/v3/users/3a12a390c4124acc9cfaee32fdc170ad` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.278227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7d24-743f-4fa4-8a7c-5da100a1d603 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.292673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] RBAC: Authorizing `identity:get_user(user_id=3a12a390c4124acc9cfaee32fdc170ad)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.294147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.295965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 516/1045] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/users/3a12a390c4124acc9cfaee32fdc170ad => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:08.301548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.310547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.315355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.316384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.316854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.317331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.328488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.330190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:08.349088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:08.350169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:08.354964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:50:08.354964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:08.354964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:08.354964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:08.354964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 530/1046] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:50:08.356197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.415793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.415997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59464461-499d-45e8-ae6e-6721814fcf83 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.454020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.455533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.455979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.456255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.466806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf37d3-b443-4e42-b4dd-a89c7050561e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.505941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.506602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.506966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.507133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.507892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:08.508199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.509610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.530443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 531/1047] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:08.534272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.534402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.534402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.553505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.647994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a0bb-a60c-4483-84dc-b27835dff7c5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.651639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 517/1048] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 12:50:08.657183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.665235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.684462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.685264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.685545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.685881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.692655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.694096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:50:08.708288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:08.709177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:08.710081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 532/1049] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:08.715243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.763876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598bf89-7241-4af1-ae7d-edb0d53e4547 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.771041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.799334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.800205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.800481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.800752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.801942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=298a033e314d4c63b36958787412a59d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.803415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.805132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 518/1050] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/projects/298a033e314d4c63b36958787412a59d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:08.811235 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.822919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980691d-e17b-4d81-a448-bf1431db3e02 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.857726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.858725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.859179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.859455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.860240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:08.860550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.861963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.874292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 533/1051] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:08.880286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:08.913354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a34ba2-1625-493b-83fc-176954dbd0b9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:08.915280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:08.949604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869ce29-e488-4199-888b-7432abc56b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:08.950295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ce29-e488-4199-888b-7432abc56b0b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:08.950574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ce29-e488-4199-888b-7432abc56b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:08.950846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ce29-e488-4199-888b-7432abc56b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:08.951728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869ce29-e488-4199-888b-7432abc56b0b None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=298a033e314d4c63b36958787412a59d, user.id=3a12a390c4124acc9cfaee32fdc170ad) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:08.952041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869ce29-e488-4199-888b-7432abc56b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:08.953465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869ce29-e488-4199-888b-7432abc56b0b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:08.959365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 519/1052] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/role_assignments?user.id=3a12a390c4124acc9cfaee32fdc170ad&scope.project.id=298a033e314d4c63b36958787412a59d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:08.984501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ee22f-6af8-4d6b-9ede-dc3a25430401 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:09.024027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534960-c9f7-4f04-8223-bdb3dcb8403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:09.024613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534960-c9f7-4f04-8223-bdb3dcb8403b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:09.024897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534960-c9f7-4f04-8223-bdb3dcb8403b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:09.025170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534960-c9f7-4f04-8223-bdb3dcb8403b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:09.026004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534960-c9f7-4f04-8223-bdb3dcb8403b None admin] RBAC: Adding query filter params (role.id=5ca6c7162c8f4ec4bb938167d0a76187, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=8948febd509a4edca08572764acfdcba) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:09.026362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534960-c9f7-4f04-8223-bdb3dcb8403b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:09.027839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534960-c9f7-4f04-8223-bdb3dcb8403b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:09.034980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 534/1053] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:08 2022] GET /identity/v3/role_assignments?user.id=8948febd509a4edca08572764acfdcba&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=5ca6c7162c8f4ec4bb938167d0a76187 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:09.594510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20130314-27cb-4598-a051-3daf2e6d4b61 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:09.595077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20130314-27cb-4598-a051-3daf2e6d4b61 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:09.595077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20130314-27cb-4598-a051-3daf2e6d4b61 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:09.596605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 520/1054] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:09.601749 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749444f9-1e5d-47c8-a6f5-201d2bb1cafb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:09.602193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749444f9-1e5d-47c8-a6f5-201d2bb1cafb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:09.602369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749444f9-1e5d-47c8-a6f5-201d2bb1cafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:09.619504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-749444f9-1e5d-47c8-a6f5-201d2bb1cafb None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:09.620702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-749444f9-1e5d-47c8-a6f5-201d2bb1cafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:09.695413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 535/1055] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:09.719178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20130314-27cb-4598-a051-3daf2e6d4b61 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:09.762705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:09.826207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20130314-27cb-4598-a051-3daf2e6d4b61 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:09.860303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:09.861106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:09.861384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:09.861654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:09.862338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:09.863727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:09.875958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:09.877058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 12:50:09.878061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:09.882401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 521/1056] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Jun 3 12:50:09 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:09.883281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749444f9-1e5d-47c8-a6f5-201d2bb1cafb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:09.914356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:09.985687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749444f9-1e5d-47c8-a6f5-201d2bb1cafb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:10.020233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:10.020880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:10.021193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:10.021430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:10.022162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:10.022477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:10.023851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:10.028933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 536/1057] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:10.034919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:10.143751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2ffc-14c4-4782-afa7-c801745ea4e7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:10.145510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:10.184370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e7c59-5f83-4d34-a75e-9fed84e02a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:10.185048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7c59-5f83-4d34-a75e-9fed84e02a6c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:10.185335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7c59-5f83-4d34-a75e-9fed84e02a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:10.185613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7c59-5f83-4d34-a75e-9fed84e02a6c None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:10.186435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7c59-5f83-4d34-a75e-9fed84e02a6c None admin] RBAC: Adding query filter params (type=image) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:10.186750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7c59-5f83-4d34-a75e-9fed84e02a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:10.188138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7c59-5f83-4d34-a75e-9fed84e02a6c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:10.193453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 522/1058] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:10.199281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:10.299679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:10.307911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9c6af-869b-41fe-9e75-9f5bc59aebe2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:10.343465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de544d1-2877-4454-b5ff-6e7ce6e1ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:10.344397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de544d1-2877-4454-b5ff-6e7ce6e1ba6a None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:10.344917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de544d1-2877-4454-b5ff-6e7ce6e1ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:10.345289 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de544d1-2877-4454-b5ff-6e7ce6e1ba6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:10.346466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de544d1-2877-4454-b5ff-6e7ce6e1ba6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:10.348331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de544d1-2877-4454-b5ff-6e7ce6e1ba6a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:10.374183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 537/1059] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:50:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:11.204286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51a01-bf1e-440f-9756-b2f4915da23e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.204870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51a01-bf1e-440f-9756-b2f4915da23e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.204870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51a01-bf1e-440f-9756-b2f4915da23e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.206379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 523/1060] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:11.211603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219783e-8775-4648-bfc1-d1b7dd98fe69 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.212049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219783e-8775-4648-bfc1-d1b7dd98fe69 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.212136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219783e-8775-4648-bfc1-d1b7dd98fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.229174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c219783e-8775-4648-bfc1-d1b7dd98fe69 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:11.230395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c219783e-8775-4648-bfc1-d1b7dd98fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:11.272320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633dab9-f741-4951-9d8d-ec9d65211a84 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.273030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633dab9-f741-4951-9d8d-ec9d65211a84 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.273315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633dab9-f741-4951-9d8d-ec9d65211a84 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.274764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 524/1061] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:50:11.280242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514e62-3563-427b-91f3-2f09b7aa51fe None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.280744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514e62-3563-427b-91f3-2f09b7aa51fe None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.281011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514e62-3563-427b-91f3-2f09b7aa51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.298191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2e514e62-3563-427b-91f3-2f09b7aa51fe None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:11.299404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2e514e62-3563-427b-91f3-2f09b7aa51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:11.307516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 538/1062] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:50:11.329856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219783e-8775-4648-bfc1-d1b7dd98fe69 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.369657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 525/1063] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:50:11.392499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514e62-3563-427b-91f3-2f09b7aa51fe None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.411915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:11.437573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219783e-8775-4648-bfc1-d1b7dd98fe69 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:11.478513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:11.479583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.479868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.480144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.490669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:11.495275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:11.498433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:11.500043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:11.500915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 539/1064] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:11.504924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514e62-3563-427b-91f3-2f09b7aa51fe None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:11.506032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.544212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:11.545098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.545555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.545971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.563246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:11.571535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:11.572502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:11.573378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 526/1065] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:11.579238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.623317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f77c-69ed-4109-a4e1-315a2ceff7f2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:11.660480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:11.661268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.661554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.661834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.662612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:11.662925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:11.664549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:11.667006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:11.677312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 540/1066] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:11.683066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.686716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96469ce9-6d13-41b7-bc12-30ce28991ae8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:11.725474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:11.725827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.726100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.726411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.727159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:11.727480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:11.728914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:11.743626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 527/1067] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:11.745221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.768148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:11.805829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecceba-0434-4c21-8ce4-791759279e22 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:11.842206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:11.843013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.843299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.843574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] PATH_INFO: `/v3/users/3a12a390c4124acc9cfaee32fdc170ad` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.844780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] RBAC: Authorizing `identity:get_user(user_id=3a12a390c4124acc9cfaee32fdc170ad)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:11.846304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:11.852708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 541/1068] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/users/3a12a390c4124acc9cfaee32fdc170ad => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:11.853804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.868546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586814c1-a410-49e9-8414-227bf5a22082 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:11.906400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:11.907205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:11.907490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:11.907769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:11.918369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:11.919825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:11.924677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:11.938168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:11.939158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:11.940069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:50:11.940069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:11.940069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:11.940069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:11.944191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 528/1069] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:50:11.945036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:11.963097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18264df1-b446-4fb2-8a3f-c711d3fe5b17 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:11.998641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:11.999901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.000159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.000468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.001703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] RBAC: Authorizing `identity:get_project(project_id=298a033e314d4c63b36958787412a59d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:12.003411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:12.005442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 542/1070] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/projects/298a033e314d4c63b36958787412a59d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:12.011150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:12.016702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:12.051763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054de3-11a5-4796-9463-e18812687af0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.088515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:12.089201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.089487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.089767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.090527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:12.091138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:12.092250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:12.104670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 529/1071] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:12.110525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:12.117667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783499-875a-40a7-a7cc-ee6716d69202 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.153447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:12.154399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.154780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.154984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d/users/3a12a390c4124acc9cfaee32fdc170ad/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.156972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] RBAC: Authorizing `identity:create_grant(project_id=298a033e314d4c63b36958787412a59d, user_id=3a12a390c4124acc9cfaee32fdc170ad, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:12.158457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:12.160784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:12.176671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 543/1072] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:50:12 2022] PUT /identity/v3/projects/298a033e314d4c63b36958787412a59d/users/3a12a390c4124acc9cfaee32fdc170ad/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:50:12.227206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4782c7-c204-48f6-b66b-5ed2dfec1c31 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.260927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:12.268672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:12.269501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.269787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.270066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.278736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:12.280519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:50:12.296994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:12.298049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:12.300978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 530/1073] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:50:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:50:12.304577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:12.424124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74db811-31ab-4275-a716-9b2165b3f080 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.458086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319e4c-db7b-46f1-bf9b-e8302976735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:12.458817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319e4c-db7b-46f1-bf9b-e8302976735b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.459068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319e4c-db7b-46f1-bf9b-e8302976735b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.459364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319e4c-db7b-46f1-bf9b-e8302976735b None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.460197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319e4c-db7b-46f1-bf9b-e8302976735b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:12.460479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319e4c-db7b-46f1-bf9b-e8302976735b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:12.461923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319e4c-db7b-46f1-bf9b-e8302976735b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:12.486045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 544/1074] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:50:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:12.491792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:12.603495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad804bb-a86d-41a4-9ec9-e94b7b0b373e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.640773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:12.641587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.641875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.642173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.653317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:12.655227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:12.673259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:12.674521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:12.675444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:50:12.675444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:12.675444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:12.675444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:12.675444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 531/1075] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:12.680633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7ddc6-3e47-4387-ba2c-697e4c69336c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.680924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7ddc6-3e47-4387-ba2c-697e4c69336c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.681203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7ddc6-3e47-4387-ba2c-697e4c69336c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.681491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:12.682757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 545/1076] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:12.687917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b095f-aaeb-4b9e-b74d-8faa2f6c6917 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.688173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b095f-aaeb-4b9e-b74d-8faa2f6c6917 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.688488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b095f-aaeb-4b9e-b74d-8faa2f6c6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.705588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c33b095f-aaeb-4b9e-b74d-8faa2f6c6917 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:12.706824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c33b095f-aaeb-4b9e-b74d-8faa2f6c6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:12.731964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:12.756128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:12.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 546/1077] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:50:12.793106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5ad38-362c-4d4c-b4b3-592116214a48 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.801116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b095f-aaeb-4b9e-b74d-8faa2f6c6917 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:12.832037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:12.832704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.832997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.833265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.833986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:12.834321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:12.835698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:12.851906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 532/1078] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:12.852973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:12.908152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b095f-aaeb-4b9e-b74d-8faa2f6c6917 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.944234 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:12.944920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:12.945208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:12.945484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:12.964079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e4ecb-b67b-42af-acf2-3a1cb66b8d76 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:12.965745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:12.996086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:13.006811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:13.007632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:13.008111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:13.008222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:13.015785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:13.017237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:13.017361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:13.019016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:50:13.032487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:13.033549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:13.035148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 533/1079] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:50:13.039310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:13.121802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 547/1080] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 12:50:13.127773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:13.149319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a833ca1-7634-4c46-8115-7d06e70e6c00 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:13.186265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:13.186934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:13.187219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:13.187499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:13.188287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:13.188598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:13.190038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:13.202513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 534/1081] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:13.208161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:13.209293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:13.231463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8c42-5a73-4da1-b781-d3c2d34d5544 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:13.235004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:13.272971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:13.273783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:13.274057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:13.274370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:13.285894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:13.287418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:13.306197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:13.307570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:13.309405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:50:13.309405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:13.309405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:13.309405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:13.309405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 548/1082] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:50:13.314258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:13.323350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a1f61-1ae1-4289-8dcb-a91af9f3bbd5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:13.360775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb930-66a9-413c-9f9f-ffe84265cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:13.361958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb930-66a9-413c-9f9f-ffe84265cdb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:13.362421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb930-66a9-413c-9f9f-ffe84265cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:13.362879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb930-66a9-413c-9f9f-ffe84265cdb1 None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/8948febd509a4edca08572764acfdcba/roles/5ca6c7162c8f4ec4bb938167d0a76187` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:13.365548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eb930-66a9-413c-9f9f-ffe84265cdb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=8948febd509a4edca08572764acfdcba, role_id=5ca6c7162c8f4ec4bb938167d0a76187)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:13.367271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eb930-66a9-413c-9f9f-ffe84265cdb1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:13.384880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 535/1083] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:50:13 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/8948febd509a4edca08572764acfdcba/roles/5ca6c7162c8f4ec4bb938167d0a76187 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:50:13.446102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edf6f1-8425-485a-9f5e-7e2a1d905220 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:13.487301 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701087dd-c740-49b0-bb14-782f2d1e0f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:13.488000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701087dd-c740-49b0-bb14-782f2d1e0f95 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:13.488284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701087dd-c740-49b0-bb14-782f2d1e0f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:13.488563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701087dd-c740-49b0-bb14-782f2d1e0f95 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:13.489307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701087dd-c740-49b0-bb14-782f2d1e0f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:13.489616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701087dd-c740-49b0-bb14-782f2d1e0f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:13.491128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701087dd-c740-49b0-bb14-782f2d1e0f95 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:13.492929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:13.508472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 549/1084] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:14.476293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56914b-0fa3-43bc-bf1b-c92e580c010e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:14.476898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56914b-0fa3-43bc-bf1b-c92e580c010e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:14.476898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56914b-0fa3-43bc-bf1b-c92e580c010e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:14.478258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 536/1085] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:14.484329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5efb-0c72-4f3d-9344-c6f32243a7e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:14.484756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5efb-0c72-4f3d-9344-c6f32243a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:14.484865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5efb-0c72-4f3d-9344-c6f32243a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:14.503977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c93e5efb-0c72-4f3d-9344-c6f32243a7e6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:14.505207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c93e5efb-0c72-4f3d-9344-c6f32243a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:14.586774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 550/1086] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:14.611986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56914b-0fa3-43bc-bf1b-c92e580c010e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:14.698609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:14.721242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56914b-0fa3-43bc-bf1b-c92e580c010e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:14.757149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:14.757883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:14.758195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:14.758471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:14.769475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:14.777004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:14.777992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:14.778884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 537/1087] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:14.784541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e5efb-0c72-4f3d-9344-c6f32243a7e6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:14.885103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e5efb-0c72-4f3d-9344-c6f32243a7e6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:14.908388 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:14.920197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:14.920946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:14.921209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:14.921494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:14.922255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:14.922558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:14.923934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:14.932619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 551/1088] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:14.938441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:15.040055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a1fec-bf2a-41ea-830b-96069b438073 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:15.075765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:15.076675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:15.076953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:15.077224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] PATH_INFO: `/v3/users/3a12a390c4124acc9cfaee32fdc170ad` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:15.078479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] RBAC: Authorizing `identity:get_user(user_id=3a12a390c4124acc9cfaee32fdc170ad)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:15.079909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:15.081535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 538/1089] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:14 2022] GET /identity/v3/users/3a12a390c4124acc9cfaee32fdc170ad => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:15.088771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:15.195516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457221-0318-416b-bf14-89c91e5e7b46 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:15.230193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:15.230867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:15.231149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:15.231409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:15.293534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:15.309249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:15.310797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:15.410556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 552/1090] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:15.416483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:15.429595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:15.520296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecef76-3c56-4588-8283-7ff2338bb927 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:15.561266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f5261-0dda-4cd0-b453-4c3223687464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:15.562050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5261-0dda-4cd0-b453-4c3223687464 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:15.562370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5261-0dda-4cd0-b453-4c3223687464 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:15.562641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5261-0dda-4cd0-b453-4c3223687464 None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:15.563860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f5261-0dda-4cd0-b453-4c3223687464 None admin] RBAC: Authorizing `identity:get_project(project_id=298a033e314d4c63b36958787412a59d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:15.565293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f5261-0dda-4cd0-b453-4c3223687464 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:15.567025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 539/1091] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:15 2022] GET /identity/v3/projects/298a033e314d4c63b36958787412a59d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:15.573353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:15.632734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc3932-ddd1-4c8c-8477-d00e862a3ac1 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:15.633042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc3932-ddd1-4c8c-8477-d00e862a3ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:15.633311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc3932-ddd1-4c8c-8477-d00e862a3ac1 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:15.634732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 540/1092] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:50:15.640530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7e442-5ce9-4f76-9aa3-36df8ab62acd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:15.640817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7e442-5ce9-4f76-9aa3-36df8ab62acd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:15.641090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7e442-5ce9-4f76-9aa3-36df8ab62acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:15.657731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b5a7e442-5ce9-4f76-9aa3-36df8ab62acd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:15.658997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b5a7e442-5ce9-4f76-9aa3-36df8ab62acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:15.663071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:15.678532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32aa398-e1cc-498d-9c9f-117e0e6f9a5f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:15.712019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:15.712678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:15.712959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:15.713235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:15.714064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=298a033e314d4c63b36958787412a59d, user.id=3a12a390c4124acc9cfaee32fdc170ad) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:15.714411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:15.715848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:15.722404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 553/1093] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:15 2022] GET /identity/v3/role_assignments?user.id=3a12a390c4124acc9cfaee32fdc170ad&scope.project.id=298a033e314d4c63b36958787412a59d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:15.727458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 541/1094] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:15.751649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:15.861605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ad8a-cba5-49b8-a134-6f94b8f6b6bc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:15.899011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:15.899834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:15.900114 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:15.900384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:15.912229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:15.920621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:15.921745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:15.922631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 554/1095] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 3 12:50:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:15.928384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7e442-5ce9-4f76-9aa3-36df8ab62acd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:15.939681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:16.036064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7e442-5ce9-4f76-9aa3-36df8ab62acd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:16.070882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:16.071551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:16.071820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:16.072104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:16.072836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:16.073140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:16.074543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:16.082708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 542/1096] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 3 12:50:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:16.088472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:16.102318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:16.191426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23a1e-85e0-4325-9201-b31501dbda65 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:16.225270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:16.226062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:16.226380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:16.226647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:16.237814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:16.239307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:16.257126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:16.258084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:16.259033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:50:16.259033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:16.259033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:16.259033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:16.259033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 555/1097] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:16.264516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:16.335466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:16.368073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b398aa-c3d6-4992-9d01-eaf52bb29aff None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:16.403043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:16.403709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:16.403994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:16.404258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:16.405016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:16.405320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:16.406740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:16.418470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 543/1098] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:16.424456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:16.488382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:16.528900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265468a2-98fb-4c12-96fa-c16a47bf5020 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:16.564361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:16.565165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:16.565446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:16.565714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:16.573740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:16.575222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:50:16.592851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:16.594021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:16.595450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 556/1099] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 3 12:50:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:16.600681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:16.710525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6412-59e8-4eb7-998f-5949066a47e0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:16.740302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:16.747902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:16.748751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:16.749615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:16.749906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:16.750797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:16.751116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:16.752583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:16.771603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 544/1100] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 3 12:50:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:16.777488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:16.885038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251cb4-0d72-4a36-a194-0e510a624bf4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:16.909709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:16.923219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:16.923877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:16.924156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:16.924432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:16.995169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:16.996555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:17.099970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 557/1101] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:17.105925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:17.206272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f97a-a5f1-4a60-ba1b-fb178a5b8566 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:17.255278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:17.255998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:17.256283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:17.256561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:17.267574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:17.269026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:17.286650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:17.287714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:17.288638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:50:17.288638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:17.288638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:50:17.288638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:17.288638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 545/1102] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:17.293727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:17.319336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:17.399751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917bbe-ba0d-4125-90f7-3dfae512f3a7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:17.435021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:17.435689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:17.436019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:17.436325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:17.437016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:17.437322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:17.438751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:17.450151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 558/1103] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:17.455913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:17.501280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:17.567650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5bf3-b607-4c63-b938-81ce8f433422 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:17.604176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:17.604976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:17.605266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:17.605538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:17.612647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:17.614101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:50:17.628435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:17.629363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:17.630325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 546/1104] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:17.635670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:17.723406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:17.743983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df619f-5e74-4215-9c2e-639fd8eec208 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:17.778450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7c8e5-4d76-454e-81d7-711d908f3bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:17.779110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c8e5-4d76-454e-81d7-711d908f3bcc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:17.779393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c8e5-4d76-454e-81d7-711d908f3bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:17.779715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c8e5-4d76-454e-81d7-711d908f3bcc None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:17.780508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7c8e5-4d76-454e-81d7-711d908f3bcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:17.780818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7c8e5-4d76-454e-81d7-711d908f3bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:17.782302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7c8e5-4d76-454e-81d7-711d908f3bcc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:17.795322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 559/1105] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:17.801484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:17.904562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:17.908175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9c50-9cd7-479d-b97e-535c8c89c8d9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:17.943479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3b6f0-762c-421b-9979-40b0c1afaaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:17.944135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3b6f0-762c-421b-9979-40b0c1afaaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:17.944426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3b6f0-762c-421b-9979-40b0c1afaaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:17.944701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3b6f0-762c-421b-9979-40b0c1afaaf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:17.945531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3b6f0-762c-421b-9979-40b0c1afaaf8 None admin] RBAC: Adding query filter params (role.id=5ca6c7162c8f4ec4bb938167d0a76187, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=8948febd509a4edca08572764acfdcba) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:17.945847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3b6f0-762c-421b-9979-40b0c1afaaf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:17.947325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3b6f0-762c-421b-9979-40b0c1afaaf8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:17.953759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 547/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:17 2022] GET /identity/v3/role_assignments?user.id=8948febd509a4edca08572764acfdcba&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=5ca6c7162c8f4ec4bb938167d0a76187 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:18.049522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fba2-c786-4f69-a0f0-260bc47063b9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:18.049744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fba2-c786-4f69-a0f0-260bc47063b9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:18.049979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fba2-c786-4f69-a0f0-260bc47063b9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:18.051406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 560/1107] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:18.057515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eb443-1125-468b-b3a4-741a990df1a6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:18.057815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eb443-1125-468b-b3a4-741a990df1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:18.058102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eb443-1125-468b-b3a4-741a990df1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:18.077120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-353eb443-1125-468b-b3a4-741a990df1a6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:18.078414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-353eb443-1125-468b-b3a4-741a990df1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:18.155172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 548/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:18.179927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fba2-c786-4f69-a0f0-260bc47063b9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:18.287135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fba2-c786-4f69-a0f0-260bc47063b9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:18.322402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded623-3032-4400-a6c1-7a7233af27e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:18.323134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded623-3032-4400-a6c1-7a7233af27e0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:18.323425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded623-3032-4400-a6c1-7a7233af27e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:18.323734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded623-3032-4400-a6c1-7a7233af27e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:18.324890 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded623-3032-4400-a6c1-7a7233af27e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:18.326385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded623-3032-4400-a6c1-7a7233af27e0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:18.328395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 561/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:18.333982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353eb443-1125-468b-b3a4-741a990df1a6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:18.432956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:18.440562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353eb443-1125-468b-b3a4-741a990df1a6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:18.476807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3f2b-a332-43b7-8ab6-38fefc542dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:18.477494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3f2b-a332-43b7-8ab6-38fefc542dc1 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:18.477790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3f2b-a332-43b7-8ab6-38fefc542dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:18.478074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3f2b-a332-43b7-8ab6-38fefc542dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:18.478823 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3f2b-a332-43b7-8ab6-38fefc542dc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:18.480263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3f2b-a332-43b7-8ab6-38fefc542dc1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:18.502635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 549/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:50:18 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:20.823661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dfdd4-b6c2-4818-a69f-75ba40902204 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:20.824194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dfdd4-b6c2-4818-a69f-75ba40902204 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:20.824194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dfdd4-b6c2-4818-a69f-75ba40902204 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:20.825467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 562/1111] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:20.832658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb2afe-9156-4685-8826-83e6e79bc868 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:20.833395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb2afe-9156-4685-8826-83e6e79bc868 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:20.833549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb2afe-9156-4685-8826-83e6e79bc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:20.856392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d9fb2afe-9156-4685-8826-83e6e79bc868 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:20.857574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d9fb2afe-9156-4685-8826-83e6e79bc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:20.928720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 550/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:20.953351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dfdd4-b6c2-4818-a69f-75ba40902204 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:20.967530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:21.079301 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dfdd4-b6c2-4818-a69f-75ba40902204 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:21.114489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:21.115341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:21.115624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:21.115899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] PATH_INFO: `/v3/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:21.117412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] RBAC: Authorizing `identity:get_role(role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:21.118822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:21.120196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 563/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:20 2022] GET /identity/v3/roles/66551becb6cc4504bfbd74555d898a06 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:21.130061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb2afe-9156-4685-8826-83e6e79bc868 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:21.215842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:21.248157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb2afe-9156-4685-8826-83e6e79bc868 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:21.296516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:21.297392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:21.297678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:21.297955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] PATH_INFO: `/v3/users/3a3f36c634084990bd9c6b90c07e4c41` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:21.311682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] RBAC: Authorizing `identity:get_user(user_id=3a3f36c634084990bd9c6b90c07e4c41)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:21.313137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:21.314849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 551/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:21 2022] GET /identity/v3/users/3a3f36c634084990bd9c6b90c07e4c41 => generated 286 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:21.324632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:21.414691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:21.446765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fce533-d5db-4725-8af5-b25ee7f7286c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:21.483324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:21.483966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:21.484251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:21.484529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:21.557005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:21.558496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:21.648476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:21.672306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 564/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:21.679148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:21.795247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd27b9-125e-471a-9e87-6b8ad3ef50a6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:21.832466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6225d3-6195-4f7b-98a3-aa921526ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:21.833314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6225d3-6195-4f7b-98a3-aa921526ed92 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:21.833882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6225d3-6195-4f7b-98a3-aa921526ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:21.833882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6225d3-6195-4f7b-98a3-aa921526ed92 None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:21.835205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6225d3-6195-4f7b-98a3-aa921526ed92 None admin] RBAC: Authorizing `identity:get_project(project_id=298a033e314d4c63b36958787412a59d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:21.836638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6225d3-6195-4f7b-98a3-aa921526ed92 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:21.838350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 552/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:21 2022] GET /identity/v3/projects/298a033e314d4c63b36958787412a59d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:21.844825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:21.952143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd803a-14f3-45ae-abaf-5f539671a2fe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:21.987164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9de916-7fca-43a7-a2dd-60b8da8473cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:21.987812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de916-7fca-43a7-a2dd-60b8da8473cd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:21.988098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de916-7fca-43a7-a2dd-60b8da8473cd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:21.988377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de916-7fca-43a7-a2dd-60b8da8473cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:21.989210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9de916-7fca-43a7-a2dd-60b8da8473cd None admin] RBAC: Adding query filter params (role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=298a033e314d4c63b36958787412a59d, user.id=3a3f36c634084990bd9c6b90c07e4c41) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:21.989528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9de916-7fca-43a7-a2dd-60b8da8473cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:21.991021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9de916-7fca-43a7-a2dd-60b8da8473cd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:21.996608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 565/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:21 2022] GET /identity/v3/role_assignments?user.id=3a3f36c634084990bd9c6b90c07e4c41&scope.project.id=298a033e314d4c63b36958787412a59d&role.id=66551becb6cc4504bfbd74555d898a06 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:24.196103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826ee6-2cd8-4f31-9504-0e12205a1af1 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:24.196985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826ee6-2cd8-4f31-9504-0e12205a1af1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:24.196985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826ee6-2cd8-4f31-9504-0e12205a1af1 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:24.199265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 553/1118] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:24.206947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b209-8cb3-416e-b6f6-6cb9c30fb202 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:24.207365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b209-8cb3-416e-b6f6-6cb9c30fb202 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:24.207513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b209-8cb3-416e-b6f6-6cb9c30fb202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:24.230846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8160b209-8cb3-416e-b6f6-6cb9c30fb202 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:24.232039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8160b209-8cb3-416e-b6f6-6cb9c30fb202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:24.275960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:24.310802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 566/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:24.334304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826ee6-2cd8-4f31-9504-0e12205a1af1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:24.344394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:24.446729 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826ee6-2cd8-4f31-9504-0e12205a1af1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:24.482153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:24.483103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:24.483389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:24.483672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] PATH_INFO: `/v3/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:24.485275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] RBAC: Authorizing `identity:get_role(role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:24.486695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:24.488068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 554/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:24 2022] GET /identity/v3/roles/66551becb6cc4504bfbd74555d898a06 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:24.494823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160b209-8cb3-416e-b6f6-6cb9c30fb202 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:24.599129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160b209-8cb3-416e-b6f6-6cb9c30fb202 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:24.634520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:24.635406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:24.635685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:24.635943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] PATH_INFO: `/v3/users/3a3f36c634084990bd9c6b90c07e4c41` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:24.637185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] RBAC: Authorizing `identity:get_user(user_id=3a3f36c634084990bd9c6b90c07e4c41)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:24.638686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:24.640370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 567/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:24 2022] GET /identity/v3/users/3a3f36c634084990bd9c6b90c07e4c41 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:24.649084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:24.731200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:24.758445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe9404-84ac-4733-a9aa-f6a44dd781ec None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:24.797722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c085b-d6f6-405a-ab87-af48a11e6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:24.798616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c085b-d6f6-405a-ab87-af48a11e6f81 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:24.798888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c085b-d6f6-405a-ab87-af48a11e6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:24.799165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c085b-d6f6-405a-ab87-af48a11e6f81 None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:24.800374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c085b-d6f6-405a-ab87-af48a11e6f81 None admin] RBAC: Authorizing `identity:get_project(project_id=298a033e314d4c63b36958787412a59d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:24.801816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c085b-d6f6-405a-ab87-af48a11e6f81 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:24.803556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 555/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:24 2022] GET /identity/v3/projects/298a033e314d4c63b36958787412a59d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:50:24.812831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:24.857700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:24.917704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4682f-025b-4356-8a64-31f2b44219bb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:24.952318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078d3f9-0e8a-487a-8f49-fe3c55941f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:24.953209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078d3f9-0e8a-487a-8f49-fe3c55941f2b None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:24.953491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078d3f9-0e8a-487a-8f49-fe3c55941f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:24.953791 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078d3f9-0e8a-487a-8f49-fe3c55941f2b None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d/users/3a3f36c634084990bd9c6b90c07e4c41/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:24.956206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078d3f9-0e8a-487a-8f49-fe3c55941f2b None admin] RBAC: Authorizing `identity:create_grant(project_id=298a033e314d4c63b36958787412a59d, user_id=3a3f36c634084990bd9c6b90c07e4c41, role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:24.957659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078d3f9-0e8a-487a-8f49-fe3c55941f2b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:24.974137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 568/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:50:24 2022] PUT /identity/v3/projects/298a033e314d4c63b36958787412a59d/users/3a3f36c634084990bd9c6b90c07e4c41/roles/66551becb6cc4504bfbd74555d898a06 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:50:27.174744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd7e0-d790-4e3c-9ada-c63f242ca7c9 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:27.175343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd7e0-d790-4e3c-9ada-c63f242ca7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:27.175343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd7e0-d790-4e3c-9ada-c63f242ca7c9 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:27.176694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 556/1124] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:27.183276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5824e-8a38-4cdf-bd94-caeccc9bad7e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:27.183715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5824e-8a38-4cdf-bd94-caeccc9bad7e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:27.183834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5824e-8a38-4cdf-bd94-caeccc9bad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:27.209414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3db5824e-8a38-4cdf-bd94-caeccc9bad7e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:27.210722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3db5824e-8a38-4cdf-bd94-caeccc9bad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:27.292684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 569/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:27.316413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cd7e0-d790-4e3c-9ada-c63f242ca7c9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:27.423936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cd7e0-d790-4e3c-9ada-c63f242ca7c9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:27.471274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:27.472133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:27.472411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:27.472686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] PATH_INFO: `/v3/roles/66551becb6cc4504bfbd74555d898a06` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:27.474159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] RBAC: Authorizing `identity:get_role(role_id=66551becb6cc4504bfbd74555d898a06)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:27.475586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:27.476999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 557/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:27 2022] GET /identity/v3/roles/66551becb6cc4504bfbd74555d898a06 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:27.483446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5824e-8a38-4cdf-bd94-caeccc9bad7e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:27.517264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:27.596031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5824e-8a38-4cdf-bd94-caeccc9bad7e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:27.631075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:27.631949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:27.632227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:27.632508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] PATH_INFO: `/v3/users/3a3f36c634084990bd9c6b90c07e4c41` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:27.633696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] RBAC: Authorizing `identity:get_user(user_id=3a3f36c634084990bd9c6b90c07e4c41)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:27.635160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:27.636784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 570/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:27 2022] GET /identity/v3/users/3a3f36c634084990bd9c6b90c07e4c41 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:27.642989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:27.658934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:27.775094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f3e54-7962-4df1-803a-835d0f6b0972 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:27.810104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:27.810780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:27.811063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:27.811342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:27.879414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:27.881135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:27.892465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:27.982643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 558/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:27.988923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:28.101654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:28.105723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a03fa-02fc-422b-95d0-04ba49a48b26 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:28.141139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6eb1a-9998-4e7c-9ea6-038633e91e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:28.142017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6eb1a-9998-4e7c-9ea6-038633e91e1c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:28.142335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6eb1a-9998-4e7c-9ea6-038633e91e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:28.142617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6eb1a-9998-4e7c-9ea6-038633e91e1c None admin] PATH_INFO: `/v3/projects/298a033e314d4c63b36958787412a59d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:28.143820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6eb1a-9998-4e7c-9ea6-038633e91e1c None admin] RBAC: Authorizing `identity:get_project(project_id=298a033e314d4c63b36958787412a59d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:28.145266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6eb1a-9998-4e7c-9ea6-038633e91e1c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:28.146985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 571/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:27 2022] GET /identity/v3/projects/298a033e314d4c63b36958787412a59d => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:28.153924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:28.262870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89eac0-9630-41b4-8a51-549871377d17 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:28.273785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:28.308738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5794-d4d9-49dd-b2c8-88629d96a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:28.309423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5794-d4d9-49dd-b2c8-88629d96a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:28.309712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5794-d4d9-49dd-b2c8-88629d96a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:28.309993 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5794-d4d9-49dd-b2c8-88629d96a2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:28.310862 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5794-d4d9-49dd-b2c8-88629d96a2f0 None admin] RBAC: Adding query filter params (role.id=66551becb6cc4504bfbd74555d898a06, scope.project.id=298a033e314d4c63b36958787412a59d, user.id=3a3f36c634084990bd9c6b90c07e4c41) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:28.311181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5794-d4d9-49dd-b2c8-88629d96a2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:28.312630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5794-d4d9-49dd-b2c8-88629d96a2f0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:28.318719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 559/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:28 2022] GET /identity/v3/role_assignments?user.id=3a3f36c634084990bd9c6b90c07e4c41&scope.project.id=298a033e314d4c63b36958787412a59d&role.id=66551becb6cc4504bfbd74555d898a06 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:30.580025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65891f-b085-4e5d-8b38-7b8c7cc518f3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:30.580540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65891f-b085-4e5d-8b38-7b8c7cc518f3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:30.580540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65891f-b085-4e5d-8b38-7b8c7cc518f3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:30.581969 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 572/1131] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:30.588428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbd15-abc2-44a8-a4ac-8e003f651e3d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:30.589183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbd15-abc2-44a8-a4ac-8e003f651e3d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:30.589316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbd15-abc2-44a8-a4ac-8e003f651e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:30.615219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0a1bbd15-abc2-44a8-a4ac-8e003f651e3d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:30.616419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0a1bbd15-abc2-44a8-a4ac-8e003f651e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:30.687979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 560/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:30.720197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65891f-b085-4e5d-8b38-7b8c7cc518f3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:30.868776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65891f-b085-4e5d-8b38-7b8c7cc518f3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:30.914241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b49f16-1453-4d07-8730-0d9aec7ba022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:30.915032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b49f16-1453-4d07-8730-0d9aec7ba022 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:30.915312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b49f16-1453-4d07-8730-0d9aec7ba022 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:30.915588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b49f16-1453-4d07-8730-0d9aec7ba022 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:30.916827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b49f16-1453-4d07-8730-0d9aec7ba022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:30.918311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b49f16-1453-4d07-8730-0d9aec7ba022 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:30.919934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 573/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:30.926171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bbd15-abc2-44a8-a4ac-8e003f651e3d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:31.031300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bbd15-abc2-44a8-a4ac-8e003f651e3d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:31.033971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:31.067350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbca16-135f-4fa8-ba01-4675633d5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:31.068009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbca16-135f-4fa8-ba01-4675633d5103 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:31.068289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbca16-135f-4fa8-ba01-4675633d5103 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:31.068571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbca16-135f-4fa8-ba01-4675633d5103 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:31.069285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbca16-135f-4fa8-ba01-4675633d5103 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:31.070774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbca16-135f-4fa8-ba01-4675633d5103 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:31.100478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 561/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:50:30 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:33.352892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63944fa-46d0-493f-bbee-4a99e2182ab1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:33.353747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63944fa-46d0-493f-bbee-4a99e2182ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:33.353747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63944fa-46d0-493f-bbee-4a99e2182ab1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:33.355923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 574/1135] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:33.365175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f03739-daa0-4dd0-a532-bd64df8e6f2e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:33.365589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f03739-daa0-4dd0-a532-bd64df8e6f2e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:33.365782 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f03739-daa0-4dd0-a532-bd64df8e6f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:33.389802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-56f03739-daa0-4dd0-a532-bd64df8e6f2e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:33.391092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-56f03739-daa0-4dd0-a532-bd64df8e6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:33.461974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 562/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:33.488019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63944fa-46d0-493f-bbee-4a99e2182ab1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:33.534775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:33.611271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63944fa-46d0-493f-bbee-4a99e2182ab1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:33.650348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b4fcf-f0a1-455e-a877-4f0601fe8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:33.651136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4fcf-f0a1-455e-a877-4f0601fe8c87 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:33.651422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4fcf-f0a1-455e-a877-4f0601fe8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:33.651696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4fcf-f0a1-455e-a877-4f0601fe8c87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:33.653000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b4fcf-f0a1-455e-a877-4f0601fe8c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:33.654502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b4fcf-f0a1-455e-a877-4f0601fe8c87 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:33.656103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 575/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:50:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:33.665490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f03739-daa0-4dd0-a532-bd64df8e6f2e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:33.759773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:33.777537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f03739-daa0-4dd0-a532-bd64df8e6f2e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:33.814546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1606f-07ee-40b9-9e98-774d78455db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:33.815214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1606f-07ee-40b9-9e98-774d78455db3 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:33.815498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1606f-07ee-40b9-9e98-774d78455db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:33.815777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1606f-07ee-40b9-9e98-774d78455db3 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:33.816491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1606f-07ee-40b9-9e98-774d78455db3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:33.817954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1606f-07ee-40b9-9e98-774d78455db3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:33.842682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 563/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:50:33 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:36.149725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34545a4-3049-43f3-b2eb-90d7f5b9b9b1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:36.150332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34545a4-3049-43f3-b2eb-90d7f5b9b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:36.150332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34545a4-3049-43f3-b2eb-90d7f5b9b9b1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:36.151679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 576/1139] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:36.157863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be001aaa-1d4c-4af8-878d-eeb80aaeb9db None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:36.158303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be001aaa-1d4c-4af8-878d-eeb80aaeb9db None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:36.158467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be001aaa-1d4c-4af8-878d-eeb80aaeb9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:36.177486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-be001aaa-1d4c-4af8-878d-eeb80aaeb9db None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:36.178713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-be001aaa-1d4c-4af8-878d-eeb80aaeb9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:36.247499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 564/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:36.273193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34545a4-3049-43f3-b2eb-90d7f5b9b9b1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:36.384820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34545a4-3049-43f3-b2eb-90d7f5b9b9b1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:36.386445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:36.421502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:36.422246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:36.422565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:36.422887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:36.433447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:36.440991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:36.442042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:36.442980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 577/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:36.448351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be001aaa-1d4c-4af8-878d-eeb80aaeb9db None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:36.522548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:36.554093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be001aaa-1d4c-4af8-878d-eeb80aaeb9db None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:36.591183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:36.591844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:36.592125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:36.592398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:36.593138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:36.593445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:36.594958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:36.603814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 565/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:36.610622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:36.713821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee479-1181-48be-88e7-e57317403f3e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:36.749101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:36.749962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:36.750610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:36.750920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] PATH_INFO: `/v3/users/11d3076cd03e463cbccce55affae7535` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:36.764348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] RBAC: Authorizing `identity:get_user(user_id=11d3076cd03e463cbccce55affae7535)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:36.765801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:36.767541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 578/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:36 2022] GET /identity/v3/users/11d3076cd03e463cbccce55affae7535 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:36.773680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:36.884041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf9101-d2ee-45a6-84c4-d6153d485b04 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:36.919651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:36.920294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:36.920569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:36.920843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:36.923948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:36.995154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:36.996529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:37.098786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 566/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:37.105605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:37.135175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:37.220650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ab982-bd88-4753-8fca-a65f9787db0e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:37.256378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76475c-fc99-4aeb-85d5-291c3124ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:37.257165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76475c-fc99-4aeb-85d5-291c3124ca50 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:37.257441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76475c-fc99-4aeb-85d5-291c3124ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:37.257709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76475c-fc99-4aeb-85d5-291c3124ca50 None admin] PATH_INFO: `/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:37.259005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76475c-fc99-4aeb-85d5-291c3124ca50 None admin] RBAC: Authorizing `identity:get_project(project_id=ab4ffaa4d5f5453d9f84f122e55f4b6d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:37.260428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76475c-fc99-4aeb-85d5-291c3124ca50 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:37.262143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 579/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:37 2022] GET /identity/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:37.268568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:37.302501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:37.372838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076251dc-a12f-4fdf-948a-69a43b98c064 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:37.416793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4f4b4-71c8-40b4-a984-e108281d00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:37.417450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f4b4-71c8-40b4-a984-e108281d00ab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:37.417736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f4b4-71c8-40b4-a984-e108281d00ab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:37.418016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f4b4-71c8-40b4-a984-e108281d00ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:37.418883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4f4b4-71c8-40b4-a984-e108281d00ab None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=ab4ffaa4d5f5453d9f84f122e55f4b6d, user.id=11d3076cd03e463cbccce55affae7535) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:37.419199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4f4b4-71c8-40b4-a984-e108281d00ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:37.420649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4f4b4-71c8-40b4-a984-e108281d00ab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:37.426565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 567/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:37 2022] GET /identity/v3/role_assignments?user.id=11d3076cd03e463cbccce55affae7535&scope.project.id=ab4ffaa4d5f5453d9f84f122e55f4b6d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:39.623846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3af5-96e3-4438-9521-64e71a9ce103 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:39.624722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3af5-96e3-4438-9521-64e71a9ce103 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:39.624722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3af5-96e3-4438-9521-64e71a9ce103 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:39.627560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 580/1147] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:39.633921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1fc4-5c3c-418b-9b63-17232644157f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:39.634654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1fc4-5c3c-418b-9b63-17232644157f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:39.634801 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1fc4-5c3c-418b-9b63-17232644157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:39.655100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-541e1fc4-5c3c-418b-9b63-17232644157f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:39.656286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-541e1fc4-5c3c-418b-9b63-17232644157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:39.726721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 568/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:39.750687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3af5-96e3-4438-9521-64e71a9ce103 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:39.852130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:39.866032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3af5-96e3-4438-9521-64e71a9ce103 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:39.902132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:39.902931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:39.903215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:39.903490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:39.914027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:39.921651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:39.922988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:39.923950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 581/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:39.929211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1fc4-5c3c-418b-9b63-17232644157f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:39.958203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:40.038475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1fc4-5c3c-418b-9b63-17232644157f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:40.076576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:40.077247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:40.077537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:40.077814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:40.078598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:40.079012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:40.081190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:40.095039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 569/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:40.101742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:40.214631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35026ae-990a-48c8-9733-c71a7cb6068e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:40.249269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:40.250149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:40.250966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:40.251177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] PATH_INFO: `/v3/users/11d3076cd03e463cbccce55affae7535` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:40.252411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] RBAC: Authorizing `identity:get_user(user_id=11d3076cd03e463cbccce55affae7535)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:40.253851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:40.255508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 582/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:40 2022] GET /identity/v3/users/11d3076cd03e463cbccce55affae7535 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:40.261456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:40.358771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:40.369052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178dea5-a4ef-4892-98a7-f7d0008fc717 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:40.412939 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d87a15-abe1-40be-8fc7-8be6754c7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:40.414196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d87a15-abe1-40be-8fc7-8be6754c7624 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:40.414601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d87a15-abe1-40be-8fc7-8be6754c7624 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:40.414975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d87a15-abe1-40be-8fc7-8be6754c7624 None admin] PATH_INFO: `/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:40.417090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d87a15-abe1-40be-8fc7-8be6754c7624 None admin] RBAC: Authorizing `identity:get_project(project_id=ab4ffaa4d5f5453d9f84f122e55f4b6d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:40.419400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d87a15-abe1-40be-8fc7-8be6754c7624 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:40.422178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 570/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:40 2022] GET /identity/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:40.428961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:40.448924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:40.549011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa4dff-37ed-4e91-82e2-687aac05ed2a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:40.585312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b76d-07f2-40e4-8847-26e2254e291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:40.586231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b76d-07f2-40e4-8847-26e2254e291a None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:40.586520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b76d-07f2-40e4-8847-26e2254e291a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:40.586790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b76d-07f2-40e4-8847-26e2254e291a None admin] PATH_INFO: `/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d/users/11d3076cd03e463cbccce55affae7535/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:40.589071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b76d-07f2-40e4-8847-26e2254e291a None admin] RBAC: Authorizing `identity:create_grant(project_id=ab4ffaa4d5f5453d9f84f122e55f4b6d, user_id=11d3076cd03e463cbccce55affae7535, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:40.590555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b76d-07f2-40e4-8847-26e2254e291a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:40.607494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 583/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:50:40 2022] PUT /identity/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d/users/11d3076cd03e463cbccce55affae7535/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:50:42.809818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40263-4975-4c23-b608-d167e967eeb2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:42.810405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40263-4975-4c23-b608-d167e967eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:42.810405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40263-4975-4c23-b608-d167e967eeb2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:42.811819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 571/1154] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:42.818602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5324be-4750-4fbc-b831-9a2e104fba77 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:42.819280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5324be-4750-4fbc-b831-9a2e104fba77 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:42.819479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5324be-4750-4fbc-b831-9a2e104fba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:42.841366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6c5324be-4750-4fbc-b831-9a2e104fba77 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:42.842611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c5324be-4750-4fbc-b831-9a2e104fba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:42.914397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 584/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:42.942968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40263-4975-4c23-b608-d167e967eeb2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:43.053824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40263-4975-4c23-b608-d167e967eeb2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:43.088687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:43.089411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:43.089697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:43.089980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:43.101418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:43.108984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:43.110151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:43.111281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 572/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:43.116590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5324be-4750-4fbc-b831-9a2e104fba77 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:43.125027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:43.233848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5324be-4750-4fbc-b831-9a2e104fba77 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:43.269373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:43.270049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:43.270365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:43.270644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:43.271394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:43.271705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:43.273110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:43.281886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 585/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:43.288713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:43.311270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:43.398201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd551bf-bac4-4b6d-b8d9-e36fda211ac0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:43.433894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:43.434795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:43.435079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:43.435354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] PATH_INFO: `/v3/users/11d3076cd03e463cbccce55affae7535` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:43.436671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] RBAC: Authorizing `identity:get_user(user_id=11d3076cd03e463cbccce55affae7535)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:43.438151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:43.440323 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 573/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:43 2022] GET /identity/v3/users/11d3076cd03e463cbccce55affae7535 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:43.447139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:43.514944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:43.551258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc7a6-c5d8-405e-94ce-f69e894382a4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:43.591012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:43.591662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:43.591945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:43.592221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:43.669037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:43.670448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:43.735333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:43.776828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 586/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:43.783274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:43.879574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:43.895389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c718fd-4f64-4207-b439-5f348a5d8094 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:43.935641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4ed52-8b90-4831-b4a2-de74086d15bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:43.936837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ed52-8b90-4831-b4a2-de74086d15bc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:43.937206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ed52-8b90-4831-b4a2-de74086d15bc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:43.937549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ed52-8b90-4831-b4a2-de74086d15bc None admin] PATH_INFO: `/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:43.939375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4ed52-8b90-4831-b4a2-de74086d15bc None admin] RBAC: Authorizing `identity:get_project(project_id=ab4ffaa4d5f5453d9f84f122e55f4b6d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:43.940815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4ed52-8b90-4831-b4a2-de74086d15bc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:43.942536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 574/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:43 2022] GET /identity/v3/projects/ab4ffaa4d5f5453d9f84f122e55f4b6d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:43.949398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:44.062865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a17805-5daf-4a1b-8410-56715befcc86 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:44.100276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db779-5353-47a4-a616-725e9b73031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:44.100923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db779-5353-47a4-a616-725e9b73031f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:44.101204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db779-5353-47a4-a616-725e9b73031f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:44.101478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db779-5353-47a4-a616-725e9b73031f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:44.102338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729db779-5353-47a4-a616-725e9b73031f None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=ab4ffaa4d5f5453d9f84f122e55f4b6d, user.id=11d3076cd03e463cbccce55affae7535) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:44.102646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729db779-5353-47a4-a616-725e9b73031f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:44.104087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729db779-5353-47a4-a616-725e9b73031f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:44.109985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 587/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:43 2022] GET /identity/v3/role_assignments?user.id=11d3076cd03e463cbccce55affae7535&scope.project.id=ab4ffaa4d5f5453d9f84f122e55f4b6d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:46.536852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d91c0-44e2-4796-9acf-b8a67614fc76 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:46.537701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d91c0-44e2-4796-9acf-b8a67614fc76 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:46.537701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d91c0-44e2-4796-9acf-b8a67614fc76 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:46.543937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 575/1162] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:46.549967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5c8-74db-43b4-902c-fa3775686eda None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:46.550443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5c8-74db-43b4-902c-fa3775686eda None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:46.550547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5c8-74db-43b4-902c-fa3775686eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:46.567682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-031dc5c8-74db-43b4-902c-fa3775686eda None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:46.568873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-031dc5c8-74db-43b4-902c-fa3775686eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:46.601284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:46.653362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 588/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:46.679183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d91c0-44e2-4796-9acf-b8a67614fc76 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:46.796634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d91c0-44e2-4796-9acf-b8a67614fc76 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:46.831398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:46.832037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:46.832324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:46.832600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:46.856484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:46.910481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:46.911973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:47.030016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 576/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:47.039450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc5c8-74db-43b4-902c-fa3775686eda None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:47.154049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc5c8-74db-43b4-902c-fa3775686eda None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:47.189900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1f4b1-2a37-46ab-b5f0-e11798c08370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:47.190730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f4b1-2a37-46ab-b5f0-e11798c08370 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:47.191016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f4b1-2a37-46ab-b5f0-e11798c08370 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:47.191292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f4b1-2a37-46ab-b5f0-e11798c08370 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:47.198433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1f4b1-2a37-46ab-b5f0-e11798c08370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:47.199894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1f4b1-2a37-46ab-b5f0-e11798c08370 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f8c1f4b1-2a37-46ab-b5f0-e11798c08370 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:47.214506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:47.215693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:50:47.216669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 589/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:50:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:47.222826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:47.279154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:47.326342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ecaf-71cd-4af7-ba95-aec83485a454 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:47.363233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f8db-d3b6-41cd-b26b-c2701d86c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:47.363888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f8db-d3b6-41cd-b26b-c2701d86c541 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:47.364171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f8db-d3b6-41cd-b26b-c2701d86c541 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:47.364445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f8db-d3b6-41cd-b26b-c2701d86c541 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:47.365163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99f8db-d3b6-41cd-b26b-c2701d86c541 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:47.365477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99f8db-d3b6-41cd-b26b-c2701d86c541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:47.366872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99f8db-d3b6-41cd-b26b-c2701d86c541 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:47.374240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 577/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 3 12:50:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:49.631654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2273-0f7d-4892-81df-20bcfb983072 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:49.632198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2273-0f7d-4892-81df-20bcfb983072 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:49.632198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2273-0f7d-4892-81df-20bcfb983072 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:49.633592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 590/1167] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:49.640147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa40b0-cf83-4d8b-aeb5-56fb5b4fd411 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:49.640865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa40b0-cf83-4d8b-aeb5-56fb5b4fd411 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:49.641015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa40b0-cf83-4d8b-aeb5-56fb5b4fd411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:49.659575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-19aa40b0-cf83-4d8b-aeb5-56fb5b4fd411 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:49.660782 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-19aa40b0-cf83-4d8b-aeb5-56fb5b4fd411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:49.730969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 578/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:49.754949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2273-0f7d-4892-81df-20bcfb983072 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:49.781670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:49.863027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2273-0f7d-4892-81df-20bcfb983072 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:49.902079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfa76f-5c7c-406c-bf6b-8004b0b54dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:49.902757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfa76f-5c7c-406c-bf6b-8004b0b54dfe None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:49.903044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfa76f-5c7c-406c-bf6b-8004b0b54dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:49.903320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfa76f-5c7c-406c-bf6b-8004b0b54dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:49.904051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfa76f-5c7c-406c-bf6b-8004b0b54dfe None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:49.905420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfa76f-5c7c-406c-bf6b-8004b0b54dfe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:49.923197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 591/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Fri Jun 3 12:50:49 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:52.210705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca6ba-16ac-4d5a-ad68-4aadd273bb87 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:52.211623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca6ba-16ac-4d5a-ad68-4aadd273bb87 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:52.211623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca6ba-16ac-4d5a-ad68-4aadd273bb87 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:52.213788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 579/1170] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:52.220232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68137c-b58f-461b-b3ca-4fa298663efd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:52.220693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68137c-b58f-461b-b3ca-4fa298663efd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:52.220786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68137c-b58f-461b-b3ca-4fa298663efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:52.240354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b68137c-b58f-461b-b3ca-4fa298663efd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:52.241542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b68137c-b58f-461b-b3ca-4fa298663efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:52.311536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 592/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:52.342868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca6ba-16ac-4d5a-ad68-4aadd273bb87 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:52.397356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:52.455162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca6ba-16ac-4d5a-ad68-4aadd273bb87 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:52.494098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ec1e6-8805-433b-9857-4e6e16d3c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:52.494926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec1e6-8805-433b-9857-4e6e16d3c824 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:52.495212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec1e6-8805-433b-9857-4e6e16d3c824 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:52.495489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec1e6-8805-433b-9857-4e6e16d3c824 None admin] PATH_INFO: `/v3/domains/9b766844f7d144b59e87a8d8d67aef8b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:52.512320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ec1e6-8805-433b-9857-4e6e16d3c824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9b766844f7d144b59e87a8d8d67aef8b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:52.514734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ec1e6-8805-433b-9857-4e6e16d3c824 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:52.517262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 580/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Fri Jun 3 12:50:52 2022] GET /identity/v3/domains/9b766844f7d144b59e87a8d8d67aef8b => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:52.523511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68137c-b58f-461b-b3ca-4fa298663efd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:52.538571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:52.631889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68137c-b58f-461b-b3ca-4fa298663efd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:52.668617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f45e7-d710-475b-a820-2bd555a17279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:52.669263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f45e7-d710-475b-a820-2bd555a17279 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:52.669541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f45e7-d710-475b-a820-2bd555a17279 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:52.669816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f45e7-d710-475b-a820-2bd555a17279 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:52.670547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f45e7-d710-475b-a820-2bd555a17279 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:52.672035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f45e7-d710-475b-a820-2bd555a17279 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:52.702532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 593/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:50:52 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:54.944702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2af45d-57af-4534-bf5a-6219ed68dfd2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:54.945558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2af45d-57af-4534-bf5a-6219ed68dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:54.945558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2af45d-57af-4534-bf5a-6219ed68dfd2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:54.947685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 581/1174] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:54.953197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9802-b900-490e-9e60-6fb5038b21c5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:54.953641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9802-b900-490e-9e60-6fb5038b21c5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:54.953735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9802-b900-490e-9e60-6fb5038b21c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:54.972407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-033e9802-b900-490e-9e60-6fb5038b21c5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:54.973587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-033e9802-b900-490e-9e60-6fb5038b21c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:55.033594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:55.042696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 594/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:55.077915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2af45d-57af-4534-bf5a-6219ed68dfd2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:55.196509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2af45d-57af-4534-bf5a-6219ed68dfd2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:55.205367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:55.233424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec61e5-b3ca-43b0-9df8-e78a764778c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:55.234399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec61e5-b3ca-43b0-9df8-e78a764778c2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:55.234687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec61e5-b3ca-43b0-9df8-e78a764778c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:55.234959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec61e5-b3ca-43b0-9df8-e78a764778c2 None admin] PATH_INFO: `/v3/domains/9b766844f7d144b59e87a8d8d67aef8b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:55.236223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec61e5-b3ca-43b0-9df8-e78a764778c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9b766844f7d144b59e87a8d8d67aef8b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:55.237662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec61e5-b3ca-43b0-9df8-e78a764778c2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:55.239321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 582/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Fri Jun 3 12:50:55 2022] GET /identity/v3/domains/9b766844f7d144b59e87a8d8d67aef8b => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:55.247967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9802-b900-490e-9e60-6fb5038b21c5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:55.350821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9802-b900-490e-9e60-6fb5038b21c5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:55.386523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4010d0-2ba6-489d-ac11-d8f5139793df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:55.387178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4010d0-2ba6-489d-ac11-d8f5139793df None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:55.387459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4010d0-2ba6-489d-ac11-d8f5139793df None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:55.387731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4010d0-2ba6-489d-ac11-d8f5139793df None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:55.388442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4010d0-2ba6-489d-ac11-d8f5139793df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:55.389876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4010d0-2ba6-489d-ac11-d8f5139793df None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:55.412244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 595/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:50:55 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:50:57.675221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fa30f-27ee-43f6-a8d7-87ec48dbcdbc None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:57.675788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fa30f-27ee-43f6-a8d7-87ec48dbcdbc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:57.675788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fa30f-27ee-43f6-a8d7-87ec48dbcdbc None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:57.677938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 583/1178] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:50:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:50:57.686984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71518b9-ab9c-4666-bf66-e63382d579d1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:57.687393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71518b9-ab9c-4666-bf66-e63382d579d1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:57.687627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71518b9-ab9c-4666-bf66-e63382d579d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:57.712103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b71518b9-ab9c-4666-bf66-e63382d579d1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:50:57.713309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b71518b9-ab9c-4666-bf66-e63382d579d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:50:57.763136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:57.788059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 596/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:50:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:50:57.812550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fa30f-27ee-43f6-a8d7-87ec48dbcdbc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:57.928206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fa30f-27ee-43f6-a8d7-87ec48dbcdbc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:57.963451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49207592-468f-41de-bbdc-66108a7623da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:57.964239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49207592-468f-41de-bbdc-66108a7623da None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:57.964521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49207592-468f-41de-bbdc-66108a7623da None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:57.964798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49207592-468f-41de-bbdc-66108a7623da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:57.976544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49207592-468f-41de-bbdc-66108a7623da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-49207592-468f-41de-bbdc-66108a7623da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:50:57.984085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:50:57.985153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:50:57.986561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 584/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:50:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:50:57.993305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71518b9-ab9c-4666-bf66-e63382d579d1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:58.097927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71518b9-ab9c-4666-bf66-e63382d579d1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:58.133693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:58.134418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:58.134687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:58.134968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:58.135712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:58.136025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:58.137413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:58.146500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 597/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:50:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:58.151997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49207592-468f-41de-bbdc-66108a7623da None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:58.189205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:58.254272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49207592-468f-41de-bbdc-66108a7623da None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:58.290057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:58.290978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:58.291265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:58.291560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] PATH_INFO: `/v3/users/5715e4a67e084cb186fd8abe0a13c1e4` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:58.305424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] RBAC: Authorizing `identity:get_user(user_id=5715e4a67e084cb186fd8abe0a13c1e4)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:58.306948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:58.308616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 585/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:50:58 2022] GET /identity/v3/users/5715e4a67e084cb186fd8abe0a13c1e4 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:58.316495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:58.373381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:58.443063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd002c-73cc-4e39-ba21-16ee7da3da0d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:58.482616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:58.483261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:58.483546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:58.483820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:58.562067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:58.563567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:58.606568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:58.666177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 598/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:50:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:50:58.677158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:58.775736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:50:58.784326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0737c-45c5-4ea0-aa53-3a53d37838c6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:58.823630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df418a6e-a692-46d6-ab87-aa9317012342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:58.824494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df418a6e-a692-46d6-ab87-aa9317012342 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:58.824777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df418a6e-a692-46d6-ab87-aa9317012342 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:58.825049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df418a6e-a692-46d6-ab87-aa9317012342 None admin] PATH_INFO: `/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:58.826305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df418a6e-a692-46d6-ab87-aa9317012342 None admin] RBAC: Authorizing `identity:get_project(project_id=2a9845a88fcb43ed8e4895f97cea0c5c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:58.827769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df418a6e-a692-46d6-ab87-aa9317012342 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:58.829501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 586/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:50:58 2022] GET /identity/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:50:58.835848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:50:58.940917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59317-6e34-447c-8e8f-984b9cb01326 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:50:58.976053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f1f33-aa5f-4aa6-b1ca-2e8e1edfc2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:50:58.976739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f1f33-aa5f-4aa6-b1ca-2e8e1edfc2ad None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:50:58.977051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f1f33-aa5f-4aa6-b1ca-2e8e1edfc2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:50:58.977300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f1f33-aa5f-4aa6-b1ca-2e8e1edfc2ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:50:58.978150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f1f33-aa5f-4aa6-b1ca-2e8e1edfc2ad None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=2a9845a88fcb43ed8e4895f97cea0c5c, user.id=5715e4a67e084cb186fd8abe0a13c1e4) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:50:58.978463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f1f33-aa5f-4aa6-b1ca-2e8e1edfc2ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:50:58.979904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f1f33-aa5f-4aa6-b1ca-2e8e1edfc2ad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:50:58.985509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 599/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:50:58 2022] GET /identity/v3/role_assignments?user.id=5715e4a67e084cb186fd8abe0a13c1e4&scope.project.id=2a9845a88fcb43ed8e4895f97cea0c5c&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:01.196922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261901c-77b5-4d53-b995-6cf7247f922b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:01.197820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261901c-77b5-4d53-b995-6cf7247f922b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:01.197820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261901c-77b5-4d53-b995-6cf7247f922b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:01.200064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 587/1186] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:51:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:51:01.206015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf134e6-004d-4b25-ac1d-d326bd69b7f8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:01.206520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf134e6-004d-4b25-ac1d-d326bd69b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:01.206626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf134e6-004d-4b25-ac1d-d326bd69b7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:01.219778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:01.225926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cdf134e6-004d-4b25-ac1d-d326bd69b7f8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:51:01.227159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cdf134e6-004d-4b25-ac1d-d326bd69b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:51:01.299306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 600/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:51:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:51:01.323147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261901c-77b5-4d53-b995-6cf7247f922b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:01.436512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261901c-77b5-4d53-b995-6cf7247f922b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:01.471183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:01.471958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:01.472242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:01.472510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:01.483132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:51:01.490897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:51:01.491974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:51:01.492978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 588/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:51:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:51:01.498798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf134e6-004d-4b25-ac1d-d326bd69b7f8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:01.611619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf134e6-004d-4b25-ac1d-d326bd69b7f8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:01.651466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:01.652165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:01.652449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:01.652730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:01.653481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:51:01.653790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:01.655230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:01.657480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:01.665037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 601/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:51:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:01.671295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:01.699646 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:01.795343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c50b1c-34ed-4ce5-b0c1-da9309256cde None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:01.832446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:01.833303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:01.833580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:01.833851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] PATH_INFO: `/v3/users/5715e4a67e084cb186fd8abe0a13c1e4` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:01.835190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] RBAC: Authorizing `identity:get_user(user_id=5715e4a67e084cb186fd8abe0a13c1e4)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:01.836622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:01.838259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 589/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:51:01 2022] GET /identity/v3/users/5715e4a67e084cb186fd8abe0a13c1e4 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:01.846973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:01.957579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91be5c-8f1e-477b-b76a-428c1788ba2c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:01.994904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40cf5-9641-4826-b360-00a80a267df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:01.995775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40cf5-9641-4826-b360-00a80a267df0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:01.996070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40cf5-9641-4826-b360-00a80a267df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:01.996338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40cf5-9641-4826-b360-00a80a267df0 None admin] PATH_INFO: `/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:01.997658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e40cf5-9641-4826-b360-00a80a267df0 None admin] RBAC: Authorizing `identity:get_project(project_id=2a9845a88fcb43ed8e4895f97cea0c5c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:01.999143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e40cf5-9641-4826-b360-00a80a267df0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:02.000847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 602/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:51:01 2022] GET /identity/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:02.008911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:02.114792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:02.125429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1995-c2e8-40f7-9a55-0a7a700c15b8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:02.161693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dc254-4353-4006-be30-87f8a5c77426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:02.162621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc254-4353-4006-be30-87f8a5c77426 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:02.162907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc254-4353-4006-be30-87f8a5c77426 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:02.163182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc254-4353-4006-be30-87f8a5c77426 None admin] PATH_INFO: `/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c/users/5715e4a67e084cb186fd8abe0a13c1e4/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:02.165412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dc254-4353-4006-be30-87f8a5c77426 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a9845a88fcb43ed8e4895f97cea0c5c, user_id=5715e4a67e084cb186fd8abe0a13c1e4, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:02.166899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dc254-4353-4006-be30-87f8a5c77426 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:02.183532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 590/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:51:02 2022] PUT /identity/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c/users/5715e4a67e084cb186fd8abe0a13c1e4/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:51:04.393453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014226-4fdc-457d-b969-aca12b2e6f12 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:04.394369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014226-4fdc-457d-b969-aca12b2e6f12 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:04.394481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014226-4fdc-457d-b969-aca12b2e6f12 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:04.396732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 603/1193] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:51:04.403183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a739a-bf08-4fe4-9d25-0768ea321728 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:04.403942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a739a-bf08-4fe4-9d25-0768ea321728 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:04.404101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a739a-bf08-4fe4-9d25-0768ea321728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:04.429435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6d3a739a-bf08-4fe4-9d25-0768ea321728 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:51:04.430689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6d3a739a-bf08-4fe4-9d25-0768ea321728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:51:04.501929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 591/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:51:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:51:04.531655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61014226-4fdc-457d-b969-aca12b2e6f12 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:04.614988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:04.660913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61014226-4fdc-457d-b969-aca12b2e6f12 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:04.696067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:04.696854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:04.697133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:04.697399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:04.707886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:51:04.715368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:51:04.717625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:51:04.718726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 604/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:51:04.722994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a739a-bf08-4fe4-9d25-0768ea321728 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:04.821688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:04.851854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a739a-bf08-4fe4-9d25-0768ea321728 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:04.888545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:04.889214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:04.889498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:04.889770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:04.890571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:51:04.890881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:04.892704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:04.900596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 592/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:04.907307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:05.017333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfde7e5-22f2-422e-a3d3-48202c874247 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:05.045449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:05.055400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:05.056273 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:05.056559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:05.056833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] PATH_INFO: `/v3/users/5715e4a67e084cb186fd8abe0a13c1e4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:05.058151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] RBAC: Authorizing `identity:get_user(user_id=5715e4a67e084cb186fd8abe0a13c1e4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:05.059630 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:05.061257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 605/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 3 12:51:04 2022] GET /identity/v3/users/5715e4a67e084cb186fd8abe0a13c1e4 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:05.067842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:05.177650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3e6d7-1a69-4445-bc13-e9e9dd7903fb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:05.213214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:05.213860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:05.214155 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:05.214441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:05.226734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:05.299318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:05.300741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:05.416807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 593/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:51:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:51:05.425954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:05.543889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63abd-1910-4b8a-8d26-33e10210c73f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:05.580646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64628-1a25-49fd-a058-4ddd89a67a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:05.581449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64628-1a25-49fd-a058-4ddd89a67a8c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:05.581710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64628-1a25-49fd-a058-4ddd89a67a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:05.582001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64628-1a25-49fd-a058-4ddd89a67a8c None admin] PATH_INFO: `/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:05.583278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b64628-1a25-49fd-a058-4ddd89a67a8c None admin] RBAC: Authorizing `identity:get_project(project_id=2a9845a88fcb43ed8e4895f97cea0c5c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:05.584719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b64628-1a25-49fd-a058-4ddd89a67a8c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:05.586472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 606/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 3 12:51:05 2022] GET /identity/v3/projects/2a9845a88fcb43ed8e4895f97cea0c5c => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:05.592877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:51:05.637580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:05.695793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098e1df-6462-45b1-a259-16ef2acd6977 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:51:05.731329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5903066-e657-4686-bd90-da0e96bd57d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:51:05.731972 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903066-e657-4686-bd90-da0e96bd57d8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:51:05.732256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903066-e657-4686-bd90-da0e96bd57d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:51:05.732533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903066-e657-4686-bd90-da0e96bd57d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:51:05.733358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5903066-e657-4686-bd90-da0e96bd57d8 None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=2a9845a88fcb43ed8e4895f97cea0c5c, user.id=5715e4a67e084cb186fd8abe0a13c1e4) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:51:05.733673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5903066-e657-4686-bd90-da0e96bd57d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:51:05.735147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5903066-e657-4686-bd90-da0e96bd57d8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:51:05.741197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 594/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:51:05 2022] GET /identity/v3/role_assignments?user.id=5715e4a67e084cb186fd8abe0a13c1e4&scope.project.id=2a9845a88fcb43ed8e4895f97cea0c5c&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:51:15.574928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=69 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:51:15.738511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=47 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:07.314261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83af7e4-8e3d-462d-a702-032ee7f8919a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:07.314874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83af7e4-8e3d-462d-a702-032ee7f8919a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:07.314874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83af7e4-8e3d-462d-a702-032ee7f8919a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:07.316014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 607/1201] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:07.321828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35fd7-b1da-4191-86f0-b8fdd536be29 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:07.322333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35fd7-b1da-4191-86f0-b8fdd536be29 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:07.322437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35fd7-b1da-4191-86f0-b8fdd536be29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:07.341025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-daa35fd7-b1da-4191-86f0-b8fdd536be29 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:07.342490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-daa35fd7-b1da-4191-86f0-b8fdd536be29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:07.428044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 595/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:07.452874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83af7e4-8e3d-462d-a702-032ee7f8919a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:07.580277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83af7e4-8e3d-462d-a702-032ee7f8919a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:07.617595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:07.618546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:07.618831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:07.619107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:07.630967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:07.633221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:07.653394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:07.654556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:07.655529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:07.655529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:07.655529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:07.655529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:07.655529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 608/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:07.661250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35fd7-b1da-4191-86f0-b8fdd536be29 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:07.785961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35fd7-b1da-4191-86f0-b8fdd536be29 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:07.821980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:07.828440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453ef09-f05c-46cd-9ce1-f5f1b6a42ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:07.829214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453ef09-f05c-46cd-9ce1-f5f1b6a42ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:07.829570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453ef09-f05c-46cd-9ce1-f5f1b6a42ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:07.829922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453ef09-f05c-46cd-9ce1-f5f1b6a42ab1 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:07.831091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453ef09-f05c-46cd-9ce1-f5f1b6a42ab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:07.831590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453ef09-f05c-46cd-9ce1-f5f1b6a42ab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:07.833188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453ef09-f05c-46cd-9ce1-f5f1b6a42ab1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:07.848501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 596/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:52:07.855831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:07.924497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:07.981185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b9f1-afaa-49dd-a401-92ecf5a3bd0b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:08.159698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd3a2-a35e-4a46-b001-d98af7e2558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:08.161140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd3a2-a35e-4a46-b001-d98af7e2558a None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:08.161528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd3a2-a35e-4a46-b001-d98af7e2558a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:08.161812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd3a2-a35e-4a46-b001-d98af7e2558a None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:08.162570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbd3a2-a35e-4a46-b001-d98af7e2558a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:08.164590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbd3a2-a35e-4a46-b001-d98af7e2558a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:08.198146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 609/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 3 12:52:07 2022] POST /identity/v3/users => generated 251 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:52:10.508961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f48f8a-fa63-4b6e-be20-dd6cbb5f6c86 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:10.509575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f48f8a-fa63-4b6e-be20-dd6cbb5f6c86 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:10.509575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f48f8a-fa63-4b6e-be20-dd6cbb5f6c86 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:10.511095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 597/1206] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:10.517188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d127fc-cc40-4199-bdc2-8df3e86fb161 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:10.517687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d127fc-cc40-4199-bdc2-8df3e86fb161 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:10.517802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d127fc-cc40-4199-bdc2-8df3e86fb161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:10.541938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5d127fc-cc40-4199-bdc2-8df3e86fb161 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:10.542477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5d127fc-cc40-4199-bdc2-8df3e86fb161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:10.620446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 610/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:10.646595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f48f8a-fa63-4b6e-be20-dd6cbb5f6c86 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:10.778614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f48f8a-fa63-4b6e-be20-dd6cbb5f6c86 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:10.824062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:10.825169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:10.825519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:10.825835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:10.838714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:52:10.847746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:10.848861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:10.849719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 598/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:52:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:10.855579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d127fc-cc40-4199-bdc2-8df3e86fb161 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:10.904576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:10.981958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d127fc-cc40-4199-bdc2-8df3e86fb161 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:11.031175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:11.031175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:11.031175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:11.031175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:11.031611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:11.031854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:11.033402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:11.043573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 611/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:11.049240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:11.106684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:11.167179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153fe56-7445-45fe-a4ae-f21c83f2e712 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:11.205762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:11.206784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:11.208286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:11.208286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:11.218985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:11.220767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:11.241746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:11.242829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:11.243740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:11.243740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:11.243740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:11.243740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:11.243740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 599/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:52:11.250249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:11.364819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:11.368592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862a65e-e5c3-424e-8d57-f3c934e7349b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:11.406377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:11.407040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:11.407322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:11.407594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:11.408315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:11.408621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:11.409990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:11.426341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 612/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:11.427594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:11.539038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafa8b-6e55-42c7-9e2a-732ac50c4bbf None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:11.544360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:11.603176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:11.604017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:11.604305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:11.604614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:11.613136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:11.614563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:52:11.630509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:11.631808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:11.632997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:11.633623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 600/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:52:11.639648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:11.760101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6932a-c868-4080-9659-e940a92b8e1d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:11.796480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:11.797161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:11.797443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:11.797719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:11.798605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:11.798919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:11.800364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:11.818783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 613/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 3 12:52:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:52:11.824663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:11.945079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3050590-4349-4abb-910f-23ea8da70325 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:11.988100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:11.988907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:11.989198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:11.989476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:12.025620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:12.084379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:12.086015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:12.213623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 601/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:52:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:52:12.214250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:12.237589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:12.339362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8aba6-b2aa-4192-911b-13b26be8d400 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:12.386526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:12.387672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:12.388107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:12.388455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:12.400990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:12.402581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:12.421772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:12.422972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:12.428710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:12.428710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:12.428710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:12.428710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:12.428710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 614/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:52:12.429017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:12.499297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:12.542960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e425-b3c1-4815-8374-02176f1a9bb7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:12.585250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:12.586100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:12.586469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:12.586748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:12.587687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:12.588042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:12.589778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:12.608296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 602/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:12.609798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:12.694192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:12.725362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606bc87-2376-4cd6-b8ee-eff5d787e006 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:12.763207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:12.763893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:12.764204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:12.764482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:12.772497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:12.774003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:52:12.789308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:12.790594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:12.791925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:12.795570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 615/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:12.796495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:12.903738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b0227-9c7a-4bbf-9ce6-25d14bb2783e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:12.930945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:12.943704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68db02-410f-45b1-8a98-71d95e55afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:12.944732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68db02-410f-45b1-8a98-71d95e55afa1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:12.945024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68db02-410f-45b1-8a98-71d95e55afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:12.945247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68db02-410f-45b1-8a98-71d95e55afa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:12.946033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68db02-410f-45b1-8a98-71d95e55afa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:12.946374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68db02-410f-45b1-8a98-71d95e55afa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:12.947814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68db02-410f-45b1-8a98-71d95e55afa1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:12.965925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 603/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:12.967433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:13.078948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8915348-3603-47f8-bcc5-3f19176f4c7c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:13.110659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:13.119287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb5834-8e9e-4687-8a39-ab56196bf0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:13.120184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb5834-8e9e-4687-8a39-ab56196bf0ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:13.120559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb5834-8e9e-4687-8a39-ab56196bf0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:13.120997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb5834-8e9e-4687-8a39-ab56196bf0ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:13.122141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb5834-8e9e-4687-8a39-ab56196bf0ff None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=7694db301bef4371a85993f54ad55d81) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:13.122545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb5834-8e9e-4687-8a39-ab56196bf0ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:13.124308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb5834-8e9e-4687-8a39-ab56196bf0ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:13.132087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 616/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:52:12 2022] GET /identity/v3/role_assignments?user.id=7694db301bef4371a85993f54ad55d81&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:15.644601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e1f8-715c-4616-a064-2c73552d9410 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:15.645170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e1f8-715c-4616-a064-2c73552d9410 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:15.645274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e1f8-715c-4616-a064-2c73552d9410 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:15.647369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 604/1220] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:15.652929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692896-79aa-4c0b-8f80-adb3bd4b9dd2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:15.653437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692896-79aa-4c0b-8f80-adb3bd4b9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:15.653725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692896-79aa-4c0b-8f80-adb3bd4b9dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:15.674307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fe692896-79aa-4c0b-8f80-adb3bd4b9dd2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:15.675389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe692896-79aa-4c0b-8f80-adb3bd4b9dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:15.755597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 617/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:15.780368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00e1f8-715c-4616-a064-2c73552d9410 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:15.929533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00e1f8-715c-4616-a064-2c73552d9410 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:15.988726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:15.989826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:15.990179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:15.990432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:16.003802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:52:16.012731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:16.013844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:16.014896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 605/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:52:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:16.020222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe692896-79aa-4c0b-8f80-adb3bd4b9dd2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:16.151458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe692896-79aa-4c0b-8f80-adb3bd4b9dd2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:16.183037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:16.198360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:16.199138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:16.199426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:16.199739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:16.200547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:16.200856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:16.202324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:16.218393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 618/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:52:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:16.219754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:16.276864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:16.345996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2fbd-4c3d-4199-903e-7a14ced600ea None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:16.381486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:16.382450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:16.382733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:16.383006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:16.395829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:16.397881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:16.417111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:16.418347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:16.424179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:16.424179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:16.424179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:16.424179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:16.424179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 606/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:16.425598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:16.538605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d70ce-5b17-494c-acbc-8722b8026259 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:16.575466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:16.576133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:16.576418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:16.576691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:16.577418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:16.577725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:16.579136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:16.591346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 619/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:16.597343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:16.698686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:16.706060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8ac34-8dca-4993-b69a-881f745e1e7b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:16.743450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:16.744324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:16.744606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:16.744877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] PATH_INFO: `/v3/users/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:16.753600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:16.755491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:52:16.770016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:16.771189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:16.772340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 607/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:16.777631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:16.830208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:16.888751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1591eb-317e-4d28-9fc9-2ef805011008 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:16.925920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:16.926684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:16.926964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:16.927237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:16.928071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:16.928383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:16.930087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:16.948199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 620/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 3 12:52:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:52:16.953758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:17.060435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173485f-679a-4841-ad4f-1f92bb8f01af None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:17.100947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:17.101690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:17.101973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:17.102326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:17.113100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:17.114614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:17.133924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:17.135211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:17.136388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:17.136388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:17.136388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:17.136388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:17.136388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 608/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:17.141108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:17.245170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1681-ea21-458c-8903-c25a1ae141dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:17.247861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:17.286696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:17.287412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:17.287792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:17.288247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:17.289275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:17.289621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:17.291432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:17.305922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 621/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:17.312887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:17.324992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:17.429620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2cf28-de24-4419-aaf0-7fd0f2858ca9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:17.465343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:17.466300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:17.466686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:17.466982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:17.473983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:17.475550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:52:17.489869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:17.490977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:17.492125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 609/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:52:17.497181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:17.607295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571decea-228c-46d4-a660-5c5955d4f28a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:17.643239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1e055-5653-462b-9c4c-f4a7a9c7c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:17.643987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e055-5653-462b-9c4c-f4a7a9c7c071 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:17.644343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e055-5653-462b-9c4c-f4a7a9c7c071 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:17.644674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e055-5653-462b-9c4c-f4a7a9c7c071 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:17.645690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e055-5653-462b-9c4c-f4a7a9c7c071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:17.646038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e055-5653-462b-9c4c-f4a7a9c7c071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:17.648065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e055-5653-462b-9c4c-f4a7a9c7c071 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:17.661052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 622/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:17.667676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:17.742723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:17.780398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e4b61-6233-4cd9-acd6-3da1b04a810a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:17.826674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f52939-b374-4567-87c9-77280cb8eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:17.827670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f52939-b374-4567-87c9-77280cb8eace None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:17.827951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f52939-b374-4567-87c9-77280cb8eace None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:17.828258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f52939-b374-4567-87c9-77280cb8eace None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/7694db301bef4371a85993f54ad55d81/roles/664cd40cb8424f818c65b66e06e19363` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:17.847427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f52939-b374-4567-87c9-77280cb8eace None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=7694db301bef4371a85993f54ad55d81, role_id=664cd40cb8424f818c65b66e06e19363)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:17.848896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f52939-b374-4567-87c9-77280cb8eace None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:17.862585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 610/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:52:17 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/7694db301bef4371a85993f54ad55d81/roles/664cd40cb8424f818c65b66e06e19363 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:52:20.271559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e17efa-90bf-477d-a864-99c4b5221521 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:20.272139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e17efa-90bf-477d-a864-99c4b5221521 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:20.272241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e17efa-90bf-477d-a864-99c4b5221521 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:20.273683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 623/1233] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:20.281829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67eb39-0a61-4eec-b4ad-eacbbd16d894 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:20.281829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67eb39-0a61-4eec-b4ad-eacbbd16d894 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:20.281829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67eb39-0a61-4eec-b4ad-eacbbd16d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:20.299128 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3b67eb39-0a61-4eec-b4ad-eacbbd16d894 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:20.300334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3b67eb39-0a61-4eec-b4ad-eacbbd16d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:20.375118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 611/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:20.399869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e17efa-90bf-477d-a864-99c4b5221521 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:20.426679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:20.508691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e17efa-90bf-477d-a864-99c4b5221521 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:20.552952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:20.553765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:20.554048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:20.554353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:20.565698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:52:20.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:20.575205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:20.576068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 624/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 3 12:52:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:20.582054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67eb39-0a61-4eec-b4ad-eacbbd16d894 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:20.632153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:20.692271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67eb39-0a61-4eec-b4ad-eacbbd16d894 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:20.727672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:20.728349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:20.728634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:20.728907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:20.729658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:20.729967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:20.731494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:20.740921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 612/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 3 12:52:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:20.747460 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:20.844674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:20.864823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45125b8-0598-4e68-96ae-02d51fcbd7fe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:20.906625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:20.907438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:20.907722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:20.907997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:20.920474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:20.922233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:20.942381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:20.943383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:20.944270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:20.944270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:20.944270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:20.944270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:20.944270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 625/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:20.950135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:21.056204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab175d1-926d-4a9f-893a-8ec362bab1a0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:21.066339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:21.095089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:21.095681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:21.095969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:21.096248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:21.096988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:21.097297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:21.098722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:21.110806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 613/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:21.116991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:21.238542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74e76-7d2d-4b45-842f-34a9a55db8a5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:21.278094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:21.278996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:21.279365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:21.279689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:21.284825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:21.291567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:21.293298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:52:21.312828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:21.314124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:21.315229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 626/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:21.324554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:21.433624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352971eb-5443-4c4c-aa29-ed27b10fdaab None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:21.468980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:21.469652 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:21.469953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:21.470311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:21.471186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:21.471518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:21.473090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:21.493203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 614/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 3 12:52:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:21.499116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:21.624974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609197-a39f-456d-90fe-6b319277f02e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:21.663498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:21.664178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:21.664662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:21.664971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:21.733800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:21.741106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:21.742688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:21.859412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 627/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:52:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:52:21.865571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:21.899334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:21.976771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb9e35-30ff-46a0-afb7-d3d13695f1b4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:22.016557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:22.017461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:22.017747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:22.018128 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:22.029960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:22.031454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:22.049584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:22.051217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:22.053251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:22.053251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:22.053251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:22.053251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:22.053251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 615/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:22.057298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:22.164328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:22.174195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab79e3d-bf71-45c8-adc6-5cc153d047b5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:22.212473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:22.213147 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:22.213433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:22.213712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:22.214483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:22.214792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:22.216181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:22.227969 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 628/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:22.233956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:22.327041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:22.352435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb7fb4-948a-4e1e-8614-87e39d00e112 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:22.391595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:22.392407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:22.392771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:22.392965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:22.401093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:22.402732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:52:22.418419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:22.419572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:22.420811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 616/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:52:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:22.426029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:22.545402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70684d9-fe51-46a1-a7d3-7dd153b9d584 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:22.591490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99308e5-656d-4438-9459-52cfd8a57a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:22.592074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99308e5-656d-4438-9459-52cfd8a57a05 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:22.592478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99308e5-656d-4438-9459-52cfd8a57a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:22.592628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99308e5-656d-4438-9459-52cfd8a57a05 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:22.593425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99308e5-656d-4438-9459-52cfd8a57a05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:22.593723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99308e5-656d-4438-9459-52cfd8a57a05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:22.595284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99308e5-656d-4438-9459-52cfd8a57a05 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:22.609061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 629/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:22.615447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:22.723483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193877-177f-48fd-8440-b105c8d23af5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:22.760627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffd1cf-03ab-4069-a56b-16675beac9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:22.761294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffd1cf-03ab-4069-a56b-16675beac9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:22.761579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffd1cf-03ab-4069-a56b-16675beac9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:22.761857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffd1cf-03ab-4069-a56b-16675beac9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:22.762796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffd1cf-03ab-4069-a56b-16675beac9e1 None admin] RBAC: Adding query filter params (role.id=664cd40cb8424f818c65b66e06e19363, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=7694db301bef4371a85993f54ad55d81) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:22.763110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffd1cf-03ab-4069-a56b-16675beac9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:22.764568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffd1cf-03ab-4069-a56b-16675beac9e1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:22.770560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 617/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:52:22 2022] GET /identity/v3/role_assignments?user.id=7694db301bef4371a85993f54ad55d81&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=664cd40cb8424f818c65b66e06e19363 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:25.368001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b616fd1-6f83-474f-b363-0aebc9229bee None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:25.368613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b616fd1-6f83-474f-b363-0aebc9229bee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:25.368889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b616fd1-6f83-474f-b363-0aebc9229bee None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:25.370285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 630/1247] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:25.375845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa020c-8e8e-4a40-86b8-b919c60ea67a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:25.376293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa020c-8e8e-4a40-86b8-b919c60ea67a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:25.376416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa020c-8e8e-4a40-86b8-b919c60ea67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:25.382228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:25.395616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-32aa020c-8e8e-4a40-86b8-b919c60ea67a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:25.396799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-32aa020c-8e8e-4a40-86b8-b919c60ea67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:25.478992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 618/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:25.502972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b616fd1-6f83-474f-b363-0aebc9229bee None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:25.523724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:25.618744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b616fd1-6f83-474f-b363-0aebc9229bee None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:25.657076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:25.657911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:25.658230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:25.658601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:25.670179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:52:25.677832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:25.679161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:25.680313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 631/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:25.685606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa020c-8e8e-4a40-86b8-b919c60ea67a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:25.794199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa020c-8e8e-4a40-86b8-b919c60ea67a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:25.827858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:25.833864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:25.834748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:25.835088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:25.835401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:25.836204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:25.837178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:25.838502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:25.848743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 619/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:25.854793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:25.941519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:25.967397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bb3ab-68dd-4dfc-8ceb-f7127d87dac5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:26.008262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:26.010574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:26.010854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:26.011156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:26.023753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:26.025457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:26.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:26.045326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:26.046649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:26.046649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:26.046649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:26.046649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:26.046649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 632/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:26.051632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:26.160554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95831abd-3c64-4c49-be38-d042fb09f0a8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:26.198934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:26.199587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:26.199910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:26.200242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:26.200996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:26.201409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:26.203127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:26.216357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 620/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:26.222452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:26.339908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba719-d618-459c-9a17-fdb4bd139583 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:26.367691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:26.376782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:26.377607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:26.377889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:26.378245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:26.386593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:26.388041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:52:26.406684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:26.407899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:26.409194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 633/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:26.414136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:26.481994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:26.533193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ca53-87af-4066-bfd3-1f8b4c4770e7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:26.573988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:26.574696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:26.574977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:26.575249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:26.576793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:26.577099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:26.578749 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:26.597341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 621/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 3 12:52:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:26.603300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:26.714224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84f2bc-eb8a-49df-bae3-c60ed87420ff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:26.750397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:26.751150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:26.751472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:26.751752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:26.814503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:26.827382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:26.828918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:26.938259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 634/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:52:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:52:26.944184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:27.056111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8a92-b0c2-454d-9d71-99a116d96d85 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:27.070550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:27.096143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:27.096948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:27.097234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:27.097505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:27.109001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:27.110513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:27.128709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:27.129825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:27.131415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:27.131415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:27.131415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:27.131415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:27.134281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 622/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:27.136074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:27.229374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:27.245519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4849b3-7bae-457d-9629-29f92dc61136 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:27.282735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:27.283409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:27.283694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:27.283977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:27.284700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:27.285006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:27.286429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:27.299372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 635/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:27.308122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:27.436951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdbdb6-f0b7-4292-a711-87c12615544f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:27.473255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:27.474070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:27.474429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:27.474680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:27.482355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:27.483820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:52:27.498637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:27.500755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 623/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:27.506305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:27.611889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76eb9-81ad-400c-a1d6-1f70abafcc94 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:27.649077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9140ea-ac63-4636-a4c8-bbd1e76a4311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:27.649893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9140ea-ac63-4636-a4c8-bbd1e76a4311 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:27.650196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9140ea-ac63-4636-a4c8-bbd1e76a4311 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:27.650490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9140ea-ac63-4636-a4c8-bbd1e76a4311 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:27.651941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9140ea-ac63-4636-a4c8-bbd1e76a4311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:27.652251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9140ea-ac63-4636-a4c8-bbd1e76a4311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:27.653739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9140ea-ac63-4636-a4c8-bbd1e76a4311 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:27.667035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 636/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:52:27.673340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:27.701048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:27.780303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef5cc8-4d49-4175-b14e-111b2a50f717 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:27.820859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0a1ee-b1bb-4d6a-b865-4aaaacc9d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:27.822297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a1ee-b1bb-4d6a-b865-4aaaacc9d111 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:27.822581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a1ee-b1bb-4d6a-b865-4aaaacc9d111 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:27.822859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a1ee-b1bb-4d6a-b865-4aaaacc9d111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:27.823694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0a1ee-b1bb-4d6a-b865-4aaaacc9d111 None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=7694db301bef4371a85993f54ad55d81) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:27.824008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0a1ee-b1bb-4d6a-b865-4aaaacc9d111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:27.825450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0a1ee-b1bb-4d6a-b865-4aaaacc9d111 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:27.831375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 624/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:52:27 2022] GET /identity/v3/role_assignments?user.id=7694db301bef4371a85993f54ad55d81&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:52:30.051922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44789b-3ebd-4d9d-884e-2d39a8800d8e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:30.052474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44789b-3ebd-4d9d-884e-2d39a8800d8e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:30.052474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44789b-3ebd-4d9d-884e-2d39a8800d8e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:30.054662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 637/1261] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:30.060858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968a9e2-bde4-4024-b82b-46da5664d9a7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:30.061307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968a9e2-bde4-4024-b82b-46da5664d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:30.061417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968a9e2-bde4-4024-b82b-46da5664d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:30.079520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f968a9e2-bde4-4024-b82b-46da5664d9a7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:30.080706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f968a9e2-bde4-4024-b82b-46da5664d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:30.149528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 625/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 12:52:30.176706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44789b-3ebd-4d9d-884e-2d39a8800d8e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:30.188185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:30.286523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44789b-3ebd-4d9d-884e-2d39a8800d8e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:30.333743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:30.334581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:30.334904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:30.335254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:30.348226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:52:30.356530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:30.357695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:30.358625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 638/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:30.364248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968a9e2-bde4-4024-b82b-46da5664d9a7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:30.384740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:30.469497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968a9e2-bde4-4024-b82b-46da5664d9a7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:30.512952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:30.513620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:30.513903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:30.514217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:30.514962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:30.515269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:30.516650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:30.525456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 626/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:30.531595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:30.606011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:30.641327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4769-6b4c-45b2-aa2e-8e3c049287d8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:30.676857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:30.677658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:30.677942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:30.678250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:30.689518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:30.691009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:30.708546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:30.709571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:30.711107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:30.711107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:30.711107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:30.711107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:30.711107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 639/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:30.716637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:30.803105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:30.831290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0146df-1ed6-42ba-8faa-3f1e48647100 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:30.866946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:30.867538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:30.867857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:30.868340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:30.869139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:30.869454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:30.870864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:30.883143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 627/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:30.891991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:30.995303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb45acb-0fee-4f1b-ae29-085fb7550575 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:31.015119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:31.033088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:31.033877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:31.034146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:31.034462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:31.042758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:31.044191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:52:31.058558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:31.060040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:31.061004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 640/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:52:31.065783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:31.169493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89818-5a15-42b4-ae5d-ca2138a7bb44 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:31.205188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:31.205846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:31.206154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:31.206429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:31.207257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:31.207564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:31.209011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:31.218057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:31.227006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 628/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 3 12:52:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:31.233552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:31.341471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8baf-9a1e-4a04-ae37-fd6c6330bc81 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:31.374675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:31.375478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:31.375763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:31.376014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:31.388794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:31.390270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:31.409276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:31.410382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:31.411452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:31.411452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:31.411452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:31.411452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:31.411452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 641/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:31.416802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:31.523253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e30fb8-8677-4dd3-98f5-ed55ba5740d2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:31.558422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:31.559088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:31.559368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:31.559627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:31.560354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:31.560657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:31.562032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:31.573487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 629/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:31.582511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:31.624627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:31.704574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ad26-b894-4fd3-8d0a-1de2244765ef None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:31.741759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:31.742598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:31.742902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:31.743177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:31.750318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:31.751765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:52:31.766634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:31.767676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:31.769090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 642/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:31.776661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:31.845303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:31.892274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce82c-da49-499d-97d5-f99af8a58a73 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:31.933861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea968c6-9841-4d24-a266-c1e66e177fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:31.934562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea968c6-9841-4d24-a266-c1e66e177fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:31.934851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea968c6-9841-4d24-a266-c1e66e177fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:31.935136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea968c6-9841-4d24-a266-c1e66e177fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:31.935930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea968c6-9841-4d24-a266-c1e66e177fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:31.936244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea968c6-9841-4d24-a266-c1e66e177fa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:31.937692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea968c6-9841-4d24-a266-c1e66e177fa7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:31.950720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 630/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:31.960187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:32.062535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:32.074145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954f299-0675-4739-bb7a-9b26ee5bfe49 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:32.118586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9730da-9117-42a2-8565-5ac32f0e48cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:32.119481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9730da-9117-42a2-8565-5ac32f0e48cc None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:32.119767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9730da-9117-42a2-8565-5ac32f0e48cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:32.120056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9730da-9117-42a2-8565-5ac32f0e48cc None admin] PATH_INFO: `/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/7694db301bef4371a85993f54ad55d81/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:32.122058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9730da-9117-42a2-8565-5ac32f0e48cc None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d17e6e9d84005b102db6b4db8e22d, user_id=7694db301bef4371a85993f54ad55d81, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:32.123542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9730da-9117-42a2-8565-5ac32f0e48cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:32.141931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 643/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 3 12:52:31 2022] PUT /identity/v3/projects/a72d17e6e9d84005b102db6b4db8e22d/users/7694db301bef4371a85993f54ad55d81/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:52:34.345194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b200b-520f-4182-89ed-21ad5d0ef1f0 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:34.345760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b200b-520f-4182-89ed-21ad5d0ef1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:34.345885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b200b-520f-4182-89ed-21ad5d0ef1f0 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:34.347608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 631/1274] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:34.353224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5384a-984a-4689-bec7-bb9b235d81f3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:34.353683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5384a-984a-4689-bec7-bb9b235d81f3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:34.353776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5384a-984a-4689-bec7-bb9b235d81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:34.371399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-72a5384a-984a-4689-bec7-bb9b235d81f3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:34.372583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-72a5384a-984a-4689-bec7-bb9b235d81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:34.441055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 644/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:34.465743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b200b-520f-4182-89ed-21ad5d0ef1f0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:34.581740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b200b-520f-4182-89ed-21ad5d0ef1f0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:34.599275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:34.627603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:34.628706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:34.629077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:34.629442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:34.646329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 12:52:34.658854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:34.659853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:34.660705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 632/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 3 12:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:34.668123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5384a-984a-4689-bec7-bb9b235d81f3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:34.751636 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:34.773477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5384a-984a-4689-bec7-bb9b235d81f3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:34.810042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:34.810891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:34.811197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:34.811465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:34.812197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:34.812503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:34.813906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:34.822347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 645/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 3 12:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:34.828997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:34.940477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7562d-b10a-48d2-b887-0dde08a8c9df None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:34.975478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:34.976267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:34.976550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:34.976825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:34.988024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:34.989472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:35.007246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:35.008280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:35.009372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:35.009372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:35.009372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:35.009372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:35.009372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 633/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:35.014503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:35.124991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbffd62-4eb4-45a2-a0e7-e0dd725196b6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:35.162586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:35.163244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:35.163526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:35.163805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:35.164535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:35.164878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:35.166284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:35.178782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 646/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:35.185692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:35.227199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:35.307968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775daa1-19b5-4335-9974-a79722ac3ac1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:35.345550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:35.346524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:35.346668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:35.347060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:35.355405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:35.357049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 12:52:35.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:35.373714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:35.374719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 634/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:35.379976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:35.384518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:35.485022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06076d-d1e6-4500-aaa2-20f6c10da10d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:35.526681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:35.527698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:35.528148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:35.528586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:35.529940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:35.530358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:35.531818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:35.550685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 647/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 3 12:52:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:35.556718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:35.646813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:35.657098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799317-c23d-4b50-b135-0dad047005a4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:35.691894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:35.692529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:35.692806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:35.693085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:35.762319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:35.763699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:35.862581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:35.873554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 635/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 3 12:52:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 12:52:35.879723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:35.942419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:35.984873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72657d-8744-4660-9d95-6acaa04ce25e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:36.023105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:36.023816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:36.024112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:36.024426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:36.034768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:36.036199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 12:52:36.053489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:36.054531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:36.055670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 12:52:36.055670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 12:52:36.055670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 12:52:36.055670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:36.055670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 648/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 12:52:36.061653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:36.176115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3714-e629-4463-9daa-f1611c0ac215 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:36.212898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:36.213549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:36.213833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:36.214133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:36.214848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:36.215159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:36.216536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:36.229108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 636/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 3 12:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:36.235105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:36.339066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba08ab6-7bdd-4462-a848-8caa4c7c8fe4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:36.355024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:36.378829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:36.379620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:36.379901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:36.380178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:36.388537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:36.389977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 12:52:36.404454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:36.405477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 03 12:52:36.406572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 649/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 3 12:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:36.412630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:36.466593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:36.523853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea178739-e90d-4b50-a83c-1a747b6f9211 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:36.561076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88846c-b04d-491d-b244-30782c2c62f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:36.561746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88846c-b04d-491d-b244-30782c2c62f1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:36.562031 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88846c-b04d-491d-b244-30782c2c62f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:36.562336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88846c-b04d-491d-b244-30782c2c62f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:36.563123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88846c-b04d-491d-b244-30782c2c62f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:36.563432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88846c-b04d-491d-b244-30782c2c62f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:36.564856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88846c-b04d-491d-b244-30782c2c62f1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:36.576766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 637/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 3 12:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:36.583226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:36.693812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05c7b7-6a01-4cad-bebe-b0d561c3770b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:36.729049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347e90c-8991-4a22-a0d0-a67f2b9f53cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:36.729721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347e90c-8991-4a22-a0d0-a67f2b9f53cd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:36.730002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347e90c-8991-4a22-a0d0-a67f2b9f53cd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:36.730310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347e90c-8991-4a22-a0d0-a67f2b9f53cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:36.731152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347e90c-8991-4a22-a0d0-a67f2b9f53cd None admin] RBAC: Adding query filter params (role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb, scope.project.id=a72d17e6e9d84005b102db6b4db8e22d, user.id=7694db301bef4371a85993f54ad55d81) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:36.731464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347e90c-8991-4a22-a0d0-a67f2b9f53cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:36.732916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347e90c-8991-4a22-a0d0-a67f2b9f53cd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:36.739807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 650/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 3 12:52:36 2022] GET /identity/v3/role_assignments?user.id=7694db301bef4371a85993f54ad55d81&scope.project.id=a72d17e6e9d84005b102db6b4db8e22d&role.id=94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:39.017138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e374ef-8e3e-4955-ab76-b930ce72dee7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:39.018053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e374ef-8e3e-4955-ab76-b930ce72dee7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:39.018053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e374ef-8e3e-4955-ab76-b930ce72dee7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:39.020365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 638/1288] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:39.026840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd44205-6aa1-4f2f-a62e-24912db1e1f9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:39.027553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd44205-6aa1-4f2f-a62e-24912db1e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:39.027672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd44205-6aa1-4f2f-a62e-24912db1e1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:39.055026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bfd44205-6aa1-4f2f-a62e-24912db1e1f9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:39.056648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bfd44205-6aa1-4f2f-a62e-24912db1e1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:39.087494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:39.141747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 651/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:39.165383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e374ef-8e3e-4955-ab76-b930ce72dee7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:39.285761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e374ef-8e3e-4955-ab76-b930ce72dee7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:39.297328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:39.325732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:39.326784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:39.327076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:39.327351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:39.328150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:39.329890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:39.343411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:39.344583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:39.345549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 639/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:52:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:39.353435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd44205-6aa1-4f2f-a62e-24912db1e1f9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:39.461058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd44205-6aa1-4f2f-a62e-24912db1e1f9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:39.498702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d548ba6-7364-4e29-a63a-35095eba946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:39.499361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548ba6-7364-4e29-a63a-35095eba946a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:39.499637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548ba6-7364-4e29-a63a-35095eba946a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:39.499910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548ba6-7364-4e29-a63a-35095eba946a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:39.500623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d548ba6-7364-4e29-a63a-35095eba946a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:39.500925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d548ba6-7364-4e29-a63a-35095eba946a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:39.502329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d548ba6-7364-4e29-a63a-35095eba946a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:39.507617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 652/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 3 12:52:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:39.516796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:39.628677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8306de-c7a2-49c0-9649-6cb5bf8370ab None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:39.663831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64e5d-a9ef-4863-aafc-2a13e36ba8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:39.664501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64e5d-a9ef-4863-aafc-2a13e36ba8ef None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:39.664788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64e5d-a9ef-4863-aafc-2a13e36ba8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:39.665094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64e5d-a9ef-4863-aafc-2a13e36ba8ef None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:39.665798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64e5d-a9ef-4863-aafc-2a13e36ba8ef None admin] RBAC: Adding query filter params (type=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:39.666145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64e5d-a9ef-4863-aafc-2a13e36ba8ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:39.667525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64e5d-a9ef-4863-aafc-2a13e36ba8ef None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:39.672187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 640/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 3 12:52:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:41.888839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca5aa-cc7c-4f59-ad82-4d9cb1ce6db1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:41.889688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca5aa-cc7c-4f59-ad82-4d9cb1ce6db1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:41.889688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca5aa-cc7c-4f59-ad82-4d9cb1ce6db1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:41.891826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 653/1293] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:41.900924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d7a0-0e32-4390-b010-9a41ac229432 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:41.901662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d7a0-0e32-4390-b010-9a41ac229432 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:41.901662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d7a0-0e32-4390-b010-9a41ac229432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:41.930611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6794d7a0-0e32-4390-b010-9a41ac229432 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:41.931978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6794d7a0-0e32-4390-b010-9a41ac229432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:41.972333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:42.012405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 641/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:42.036015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca5aa-cc7c-4f59-ad82-4d9cb1ce6db1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:42.068980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:42.143899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca5aa-cc7c-4f59-ad82-4d9cb1ce6db1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:42.182399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2c385-f1a2-4073-9f31-6c4f6e432847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:42.182750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2c385-f1a2-4073-9f31-6c4f6e432847 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:42.183031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2c385-f1a2-4073-9f31-6c4f6e432847 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:42.183304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2c385-f1a2-4073-9f31-6c4f6e432847 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:42.184018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2c385-f1a2-4073-9f31-6c4f6e432847 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:42.185393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2c385-f1a2-4073-9f31-6c4f6e432847 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:42.203089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 654/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 3 12:52:42 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:52:44.490032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a614-89fb-4569-b287-040adf81c14f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:44.490697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a614-89fb-4569-b287-040adf81c14f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:44.490697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a614-89fb-4569-b287-040adf81c14f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:44.492017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 642/1296] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:44.499143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16868540-1fd4-4ce5-aa29-23c24f5c360c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:44.499917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16868540-1fd4-4ce5-aa29-23c24f5c360c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:44.500045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16868540-1fd4-4ce5-aa29-23c24f5c360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:44.521726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-16868540-1fd4-4ce5-aa29-23c24f5c360c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:44.522989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16868540-1fd4-4ce5-aa29-23c24f5c360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:44.617474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 655/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:44.641319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a614-89fb-4569-b287-040adf81c14f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:44.751667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a614-89fb-4569-b287-040adf81c14f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:44.795210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:44.796392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:44.796762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:44.797134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:44.798187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:44.800293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:44.815645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:44.816864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:44.817963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 643/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:52:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:44.825478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16868540-1fd4-4ce5-aa29-23c24f5c360c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:44.846526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:44.932803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16868540-1fd4-4ce5-aa29-23c24f5c360c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:44.968774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:44.969438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:44.969726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:44.970006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:44.970743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:44.971055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:44.972437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:44.977695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 656/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 3 12:52:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:44.984000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:45.020820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:45.096541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04240-26a3-48a3-9442-73a4072009e4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:45.141895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921193-8b21-4af6-b8cc-bebe94203b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:45.142590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921193-8b21-4af6-b8cc-bebe94203b01 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:45.142878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921193-8b21-4af6-b8cc-bebe94203b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:45.143157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921193-8b21-4af6-b8cc-bebe94203b01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:45.143949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921193-8b21-4af6-b8cc-bebe94203b01 None admin] RBAC: Adding query filter params (interface=public, service_id=4ae6274db621497e93428865a6be13bd, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:45.144265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921193-8b21-4af6-b8cc-bebe94203b01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:45.145654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921193-8b21-4af6-b8cc-bebe94203b01 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:45.150884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 644/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 3 12:52:44 2022] GET /identity/v3/endpoints?service_id=4ae6274db621497e93428865a6be13bd&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:52:45.156962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:45.245624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:45.267577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841410-3b43-4892-b8dc-a3c317ec9b40 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:45.303091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24defa-b3f6-47cf-9138-aa698a297d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:45.303687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24defa-b3f6-47cf-9138-aa698a297d04 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:45.303972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24defa-b3f6-47cf-9138-aa698a297d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:45.304248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24defa-b3f6-47cf-9138-aa698a297d04 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:45.304927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24defa-b3f6-47cf-9138-aa698a297d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:45.306339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24defa-b3f6-47cf-9138-aa698a297d04 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:45.313357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 657/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 3 12:52:45 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:52:47.530527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74586543-9c1c-4117-bf3f-1e13e3fda8d6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:47.531116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74586543-9c1c-4117-bf3f-1e13e3fda8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:47.531116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74586543-9c1c-4117-bf3f-1e13e3fda8d6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:47.532447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 645/1302] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:52:47.539896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2c472-2888-461a-bb94-220a7e94515f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:47.540430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2c472-2888-461a-bb94-220a7e94515f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:47.540535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2c472-2888-461a-bb94-220a7e94515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:47.559139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2aa2c472-2888-461a-bb94-220a7e94515f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:52:47.560330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2aa2c472-2888-461a-bb94-220a7e94515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:52:47.637645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 658/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:52:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 12:52:47.665099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74586543-9c1c-4117-bf3f-1e13e3fda8d6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:47.780605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:47.788381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74586543-9c1c-4117-bf3f-1e13e3fda8d6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:47.823580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:47.824396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:47.824680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:47.824954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:47.825611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:47.827029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 12:52:47.839518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 12:52:47.840656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 03 12:52:47.841649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 646/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 3 12:52:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 12:52:47.847257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2c472-2888-461a-bb94-220a7e94515f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:47.933055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:47.965716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2c472-2888-461a-bb94-220a7e94515f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:48.001995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff60eb7-3c74-4f4a-8512-d6427bb3f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:48.002677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60eb7-3c74-4f4a-8512-d6427bb3f363 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:48.002921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60eb7-3c74-4f4a-8512-d6427bb3f363 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:48.003231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60eb7-3c74-4f4a-8512-d6427bb3f363 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:48.003929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff60eb7-3c74-4f4a-8512-d6427bb3f363 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:52:48.004216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff60eb7-3c74-4f4a-8512-d6427bb3f363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:48.005585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff60eb7-3c74-4f4a-8512-d6427bb3f363 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:48.011247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 659/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 3 12:52:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:52:48.018087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:52:48.134222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30189a-bd6f-4807-bc9e-23ca756dc104 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:52:48.175586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34602f3-ecac-427b-bbcc-6d778226cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:52:48.176244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34602f3-ecac-427b-bbcc-6d778226cd17 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:52:48.176529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34602f3-ecac-427b-bbcc-6d778226cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:52:48.176807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34602f3-ecac-427b-bbcc-6d778226cd17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:52:48.177554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34602f3-ecac-427b-bbcc-6d778226cd17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:52:48.179010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34602f3-ecac-427b-bbcc-6d778226cd17 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:52:48.203407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 647/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 3 12:52:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:52:58.008003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=30 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:52:58.197697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:53:52.999378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d677fd-1aa8-4184-93c8-67a55486d699 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:53.000001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d677fd-1aa8-4184-93c8-67a55486d699 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:53.000001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d677fd-1aa8-4184-93c8-67a55486d699 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:53.005290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 660/1307] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:53:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:53:53.009969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520288fd-3778-48dc-b4e8-59093b2d6b07 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:53.010471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520288fd-3778-48dc-b4e8-59093b2d6b07 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:53.010556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520288fd-3778-48dc-b4e8-59093b2d6b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:53.192869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-520288fd-3778-48dc-b4e8-59093b2d6b07 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:53:53.197414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-520288fd-3778-48dc-b4e8-59093b2d6b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:53:53.358263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 648/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:53:53.409676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8319c-4f14-4d48-a609-99b802b36b9a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:53.410232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8319c-4f14-4d48-a609-99b802b36b9a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:53.410569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8319c-4f14-4d48-a609-99b802b36b9a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:53.412417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 661/1309] 10.222.0.58 () {54 vars in 964 bytes} [Fri Jun 3 12:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:53:53.421703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39e0f3-7cb0-4938-bf07-72fdce7e1c0a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:53.422211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39e0f3-7cb0-4938-bf07-72fdce7e1c0a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:53.422919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39e0f3-7cb0-4938-bf07-72fdce7e1c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:53.661526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-df39e0f3-7cb0-4938-bf07-72fdce7e1c0a None None] MFA Rules not processed for user `2fa3a98382cd4b04bb384bbc2ab3a598`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:53:53.662818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df39e0f3-7cb0-4938-bf07-72fdce7e1c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:53:53.689920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:53:53.753808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 649/1310] 10.222.0.58 () {58 vars in 1061 bytes} [Fri Jun 3 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:53:53.763641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8319c-4f14-4d48-a609-99b802b36b9a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:53:53.765393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3bd8319c-4f14-4d48-a609-99b802b36b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:53:53.885890 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8319c-4f14-4d48-a609-99b802b36b9a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:53:53.966523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d844f-526b-4ddc-9710-9c6a0eba6c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:53:53.967181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d844f-526b-4ddc-9710-9c6a0eba6c98 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:53.967463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d844f-526b-4ddc-9710-9c6a0eba6c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:53.967740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d844f-526b-4ddc-9710-9c6a0eba6c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:53.970062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-442d844f-526b-4ddc-9710-9c6a0eba6c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:53:54.032207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:53:54.103276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d844f-526b-4ddc-9710-9c6a0eba6c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:53:54.104741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d844f-526b-4ddc-9710-9c6a0eba6c98 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:53:54.128481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 662/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:53:56.725348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f376-929e-41ff-a98c-3d0c65b18e3e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:56.725917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f376-929e-41ff-a98c-3d0c65b18e3e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:56.725917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f376-929e-41ff-a98c-3d0c65b18e3e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:56.727533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 650/1312] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:53:56.733056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1f5d-8e6f-4e61-9b45-f6b5f3820ca4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:56.733497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1f5d-8e6f-4e61-9b45-f6b5f3820ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:56.733575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1f5d-8e6f-4e61-9b45-f6b5f3820ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:56.809760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6d8c1f5d-8e6f-4e61-9b45-f6b5f3820ca4 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:53:56.810980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6d8c1f5d-8e6f-4e61-9b45-f6b5f3820ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:53:56.912550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 663/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:53:56.950948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f376-929e-41ff-a98c-3d0c65b18e3e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:53:56.952490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6294f376-929e-41ff-a98c-3d0c65b18e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:53:57.067956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f376-929e-41ff-a98c-3d0c65b18e3e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:53:57.153954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:53:57.156789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f15a2-6379-4c8b-a4ef-da8d518e9196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:53:57.157293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f15a2-6379-4c8b-a4ef-da8d518e9196 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:57.157565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f15a2-6379-4c8b-a4ef-da8d518e9196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:57.157849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f15a2-6379-4c8b-a4ef-da8d518e9196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:57.159979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-614f15a2-6379-4c8b-a4ef-da8d518e9196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:53:57.282616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f15a2-6379-4c8b-a4ef-da8d518e9196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:53:57.284167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f15a2-6379-4c8b-a4ef-da8d518e9196 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:53:57.306054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 651/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:53:59.902695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef5261-3f7d-4e91-a2ed-58e916a97fa9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:59.903540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef5261-3f7d-4e91-a2ed-58e916a97fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:59.903540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef5261-3f7d-4e91-a2ed-58e916a97fa9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:59.905699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 664/1315] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:53:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:53:59.911381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bca019-82cf-4bec-aad7-3610e65235cb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:53:59.911807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bca019-82cf-4bec-aad7-3610e65235cb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:53:59.911901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bca019-82cf-4bec-aad7-3610e65235cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:53:59.978764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-11bca019-82cf-4bec-aad7-3610e65235cb None None] MFA Rules not processed for user `5d97e373a7e641b583ccdd262a905729`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:53:59.979981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-11bca019-82cf-4bec-aad7-3610e65235cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:00.034092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:00.091663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 652/1316] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:00.156867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef5261-3f7d-4e91-a2ed-58e916a97fa9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:00.156867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0ef5261-3f7d-4e91-a2ed-58e916a97fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:00.163381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:00.262309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef5261-3f7d-4e91-a2ed-58e916a97fa9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:00.353768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ffbc0-e4c5-4891-991b-236cf6d37666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:00.354445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ffbc0-e4c5-4891-991b-236cf6d37666 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:00.354730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ffbc0-e4c5-4891-991b-236cf6d37666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:00.355007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ffbc0-e4c5-4891-991b-236cf6d37666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:00.356676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-075ffbc0-e4c5-4891-991b-236cf6d37666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:00.425180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:00.484272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ffbc0-e4c5-4891-991b-236cf6d37666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:00.485753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ffbc0-e4c5-4891-991b-236cf6d37666 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:00.506096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 665/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:03.330857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163598fa-46c6-42a1-99d1-2af285bab3f4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:03.331455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163598fa-46c6-42a1-99d1-2af285bab3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:03.331455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163598fa-46c6-42a1-99d1-2af285bab3f4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:03.332798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 653/1318] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:03.339233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bfff2-1328-4ef7-b076-ff69157062cc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:03.339683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bfff2-1328-4ef7-b076-ff69157062cc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:03.339802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bfff2-1328-4ef7-b076-ff69157062cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:03.415030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5a1bfff2-1328-4ef7-b076-ff69157062cc None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:03.416254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5a1bfff2-1328-4ef7-b076-ff69157062cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:03.518971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 666/1319] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:03.561707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163598fa-46c6-42a1-99d1-2af285bab3f4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:03.563373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-163598fa-46c6-42a1-99d1-2af285bab3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:03.677368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163598fa-46c6-42a1-99d1-2af285bab3f4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:03.753735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c976e8-45eb-4b3e-8689-8edcce9f9e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:03.754400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c976e8-45eb-4b3e-8689-8edcce9f9e7c service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:03.754687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c976e8-45eb-4b3e-8689-8edcce9f9e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:03.754956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c976e8-45eb-4b3e-8689-8edcce9f9e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:03.756568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-68c976e8-45eb-4b3e-8689-8edcce9f9e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:03.764523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:03.873389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c976e8-45eb-4b3e-8689-8edcce9f9e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:03.874827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c976e8-45eb-4b3e-8689-8edcce9f9e7c service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:03.896629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 654/1320] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:54:06.845142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d709129-86c1-4e6a-9aa7-1469ecb0c06e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:06.845676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d709129-86c1-4e6a-9aa7-1469ecb0c06e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:06.845676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d709129-86c1-4e6a-9aa7-1469ecb0c06e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:06.847174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 667/1321] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:06.852701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d893f-c393-4d0e-9a26-10208ddd2619 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:06.853144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d893f-c393-4d0e-9a26-10208ddd2619 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:06.853237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d893f-c393-4d0e-9a26-10208ddd2619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:06.922290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-638d893f-c393-4d0e-9a26-10208ddd2619 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:06.923505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-638d893f-c393-4d0e-9a26-10208ddd2619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:06.986207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:07.026335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 655/1322] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:07.063484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d709129-86c1-4e6a-9aa7-1469ecb0c06e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:07.065071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d709129-86c1-4e6a-9aa7-1469ecb0c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:07.085358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:07.174206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d709129-86c1-4e6a-9aa7-1469ecb0c06e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:07.260624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9d0f4-645c-49bf-9a24-de513c857df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:07.261297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d0f4-645c-49bf-9a24-de513c857df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:07.261582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d0f4-645c-49bf-9a24-de513c857df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:07.261855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d0f4-645c-49bf-9a24-de513c857df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:07.264647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-30c9d0f4-645c-49bf-9a24-de513c857df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:07.346695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:07.386045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9d0f4-645c-49bf-9a24-de513c857df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:07.387557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9d0f4-645c-49bf-9a24-de513c857df9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:07.407282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 668/1323] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:09.702541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d91ec8-c3f5-4619-8744-5955c425d534 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:09.703141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d91ec8-c3f5-4619-8744-5955c425d534 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:09.703141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d91ec8-c3f5-4619-8744-5955c425d534 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:09.704496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 656/1324] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:09.709979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f48f6-3de0-412a-b3b4-d58cd1698dae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:09.710459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f48f6-3de0-412a-b3b4-d58cd1698dae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:09.710572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f48f6-3de0-412a-b3b4-d58cd1698dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:09.778762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-382f48f6-3de0-412a-b3b4-d58cd1698dae None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:09.780029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-382f48f6-3de0-412a-b3b4-d58cd1698dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:09.881455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 669/1325] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:09.932164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e341b-d7fb-4815-9cd4-59c0e49f143c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:09.932454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e341b-d7fb-4815-9cd4-59c0e49f143c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:09.932717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e341b-d7fb-4815-9cd4-59c0e49f143c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:09.934215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 657/1326] 10.222.0.58 () {54 vars in 964 bytes} [Fri Jun 3 12:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:09.940395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd741-06de-4240-8e1e-a12b51e69fda None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:09.940691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd741-06de-4240-8e1e-a12b51e69fda None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:09.940971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd741-06de-4240-8e1e-a12b51e69fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:09.971982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:10.019041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5c7dd741-06de-4240-8e1e-a12b51e69fda None None] MFA Rules not processed for user `2fa3a98382cd4b04bb384bbc2ab3a598`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:10.020306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c7dd741-06de-4240-8e1e-a12b51e69fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:10.096527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 670/1327] 10.222.0.58 () {58 vars in 1061 bytes} [Fri Jun 3 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:10.105864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e341b-d7fb-4815-9cd4-59c0e49f143c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:10.107557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-286e341b-d7fb-4815-9cd4-59c0e49f143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:10.216227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e341b-d7fb-4815-9cd4-59c0e49f143c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:10.292411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b02fde-1658-46d3-be69-33d7d8bfa8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:10.293067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02fde-1658-46d3-be69-33d7d8bfa8ca service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:10.293350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02fde-1658-46d3-be69-33d7d8bfa8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:10.293629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02fde-1658-46d3-be69-33d7d8bfa8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:10.295376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-08b02fde-1658-46d3-be69-33d7d8bfa8ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:10.312641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:10.412797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b02fde-1658-46d3-be69-33d7d8bfa8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:10.414298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b02fde-1658-46d3-be69-33d7d8bfa8ca service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:10.435068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 658/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:12.949158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7e32-b6f1-445d-9803-410ec4a3eed1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:12.949694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7e32-b6f1-445d-9803-410ec4a3eed1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:12.949694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7e32-b6f1-445d-9803-410ec4a3eed1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:12.951267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 671/1329] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:12.956481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6125b-615a-4bff-8337-03487f1caa29 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:12.956970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6125b-615a-4bff-8337-03487f1caa29 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:12.957075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6125b-615a-4bff-8337-03487f1caa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:13.023855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fef6125b-615a-4bff-8337-03487f1caa29 None None] MFA Rules not processed for user `5d97e373a7e641b583ccdd262a905729`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:13.025063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fef6125b-615a-4bff-8337-03487f1caa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:13.091742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:13.124719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 659/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:13.162471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7e32-b6f1-445d-9803-410ec4a3eed1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:13.164116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cbec7e32-b6f1-445d-9803-410ec4a3eed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:13.270757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7e32-b6f1-445d-9803-410ec4a3eed1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:13.291656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:13.347297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5c040-b045-4a8f-8d06-0623a2ec4a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:13.347959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5c040-b045-4a8f-8d06-0623a2ec4a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:13.348246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5c040-b045-4a8f-8d06-0623a2ec4a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:13.348523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5c040-b045-4a8f-8d06-0623a2ec4a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:13.350222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bcc5c040-b045-4a8f-8d06-0623a2ec4a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:13.467344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5c040-b045-4a8f-8d06-0623a2ec4a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:13.468815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5c040-b045-4a8f-8d06-0623a2ec4a84 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:13.488101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 672/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:15.981775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1d5e-2dbe-42a9-8f84-67cc2c098378 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:15.982470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1d5e-2dbe-42a9-8f84-67cc2c098378 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:15.982470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1d5e-2dbe-42a9-8f84-67cc2c098378 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:15.983743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 660/1332] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:15.990166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca20a8-d941-42b8-b98c-3d5b540bd6da None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:15.990620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca20a8-d941-42b8-b98c-3d5b540bd6da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:15.990728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca20a8-d941-42b8-b98c-3d5b540bd6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:16.058991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:16.062783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4aca20a8-d941-42b8-b98c-3d5b540bd6da None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:16.064580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4aca20a8-d941-42b8-b98c-3d5b540bd6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:16.172908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 673/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:16.209076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1d5e-2dbe-42a9-8f84-67cc2c098378 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:16.210690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-113c1d5e-2dbe-42a9-8f84-67cc2c098378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:16.323003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1d5e-2dbe-42a9-8f84-67cc2c098378 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:16.398555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba3182-515f-4862-87b2-22bf44cdad80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:16.399108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba3182-515f-4862-87b2-22bf44cdad80 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:16.399383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba3182-515f-4862-87b2-22bf44cdad80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:16.399653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba3182-515f-4862-87b2-22bf44cdad80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:16.401275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0aba3182-515f-4862-87b2-22bf44cdad80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:16.428887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:16.518334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba3182-515f-4862-87b2-22bf44cdad80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:16.519790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba3182-515f-4862-87b2-22bf44cdad80 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:16.539265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 661/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:18.813299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac010f-8036-486e-90f4-95d56aa0b262 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:18.813922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac010f-8036-486e-90f4-95d56aa0b262 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:18.813922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac010f-8036-486e-90f4-95d56aa0b262 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:18.815277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 674/1335] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:18.821596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511111e3-dbbd-4ca5-a093-9ea14cc74eec None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:18.822467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511111e3-dbbd-4ca5-a093-9ea14cc74eec None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:18.822670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511111e3-dbbd-4ca5-a093-9ea14cc74eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:18.896297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-511111e3-dbbd-4ca5-a093-9ea14cc74eec None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:18.897514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-511111e3-dbbd-4ca5-a093-9ea14cc74eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:18.974973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:19.000572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 662/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:19.043501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac010f-8036-486e-90f4-95d56aa0b262 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:19.045938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-78ac010f-8036-486e-90f4-95d56aa0b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:19.158770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac010f-8036-486e-90f4-95d56aa0b262 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:19.188564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:19.239612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786883b7-d937-466a-a2d3-a18c36273416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:19.240269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786883b7-d937-466a-a2d3-a18c36273416 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:19.240558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786883b7-d937-466a-a2d3-a18c36273416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:19.240834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786883b7-d937-466a-a2d3-a18c36273416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:19.242542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-786883b7-d937-466a-a2d3-a18c36273416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:19.364975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786883b7-d937-466a-a2d3-a18c36273416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:19.366509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786883b7-d937-466a-a2d3-a18c36273416 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:19.386275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 675/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:22.317118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147a1e0-29ef-407d-8498-6a2064a95b90 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:22.317964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147a1e0-29ef-407d-8498-6a2064a95b90 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:22.317964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147a1e0-29ef-407d-8498-6a2064a95b90 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:22.320100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 663/1338] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:54:22.326426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17135274-9ee3-419c-98ef-08c4babaee77 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:22.326902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17135274-9ee3-419c-98ef-08c4babaee77 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:22.327010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17135274-9ee3-419c-98ef-08c4babaee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:22.402728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-17135274-9ee3-419c-98ef-08c4babaee77 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:22.403979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17135274-9ee3-419c-98ef-08c4babaee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:22.412612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:22.502340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 676/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:22.542648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147a1e0-29ef-407d-8498-6a2064a95b90 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:22.544270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4147a1e0-29ef-407d-8498-6a2064a95b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:22.657987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147a1e0-29ef-407d-8498-6a2064a95b90 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:22.741043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb7c81-dc02-41e9-9772-275ea9e3e5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:22.741690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7c81-dc02-41e9-9772-275ea9e3e5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:22.741978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7c81-dc02-41e9-9772-275ea9e3e5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:22.742286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7c81-dc02-41e9-9772-275ea9e3e5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:22.743949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4bfb7c81-dc02-41e9-9772-275ea9e3e5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:22.781233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:22.859771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb7c81-dc02-41e9-9772-275ea9e3e5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:22.861231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb7c81-dc02-41e9-9772-275ea9e3e5b3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:22.880191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 664/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:27.130488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d62a-e32a-4bf6-ada0-8066d0b46e88 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:27.131052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d62a-e32a-4bf6-ada0-8066d0b46e88 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:27.131052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d62a-e32a-4bf6-ada0-8066d0b46e88 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:27.132372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 677/1341] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:27.137939 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06590-8664-4a79-b4ff-6a7dbe917076 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:27.138400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06590-8664-4a79-b4ff-6a7dbe917076 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:27.138626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06590-8664-4a79-b4ff-6a7dbe917076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:27.213079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5be06590-8664-4a79-b4ff-6a7dbe917076 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:27.214448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5be06590-8664-4a79-b4ff-6a7dbe917076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:27.315723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:27.332245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 665/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:27.371345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d62a-e32a-4bf6-ada0-8066d0b46e88 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:27.373705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ad69d62a-e32a-4bf6-ada0-8066d0b46e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:27.473336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d62a-e32a-4bf6-ada0-8066d0b46e88 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:27.477184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b796a-7937-49e0-9ae5-9ab9f89386d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:27.477819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b796a-7937-49e0-9ae5-9ab9f89386d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:27.478139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b796a-7937-49e0-9ae5-9ab9f89386d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:27.478424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b796a-7937-49e0-9ae5-9ab9f89386d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:27.488214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b796a-7937-49e0-9ae5-9ab9f89386d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:27.489659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b796a-7937-49e0-9ae5-9ab9f89386d0 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:27.499802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 678/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:30.487654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1ef7-95fb-443e-90c0-9ca526eeb29a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:30.488189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1ef7-95fb-443e-90c0-9ca526eeb29a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:30.488281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1ef7-95fb-443e-90c0-9ca526eeb29a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:30.489729 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 666/1344] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:30.495409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882b41-926d-4bf4-915c-78c69a4dd00b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:30.495859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882b41-926d-4bf4-915c-78c69a4dd00b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:30.495954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882b41-926d-4bf4-915c-78c69a4dd00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:30.524277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b0882b41-926d-4bf4-915c-78c69a4dd00b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:30.525499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b0882b41-926d-4bf4-915c-78c69a4dd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:30.557494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:30.609678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 679/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:30.647104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1ef7-95fb-443e-90c0-9ca526eeb29a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:30.658763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1ef7-95fb-443e-90c0-9ca526eeb29a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:30.662753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d53d2d-a527-4f1f-adf8-632960eb2f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:30.663390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53d2d-a527-4f1f-adf8-632960eb2f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:30.663679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53d2d-a527-4f1f-adf8-632960eb2f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:30.663950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53d2d-a527-4f1f-adf8-632960eb2f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:30.674022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d53d2d-a527-4f1f-adf8-632960eb2f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:30.675490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d53d2d-a527-4f1f-adf8-632960eb2f06 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:30.685014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 667/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:35.089478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ec1d-17fc-4cf5-936f-b2ffcf82355d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:35.090034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ec1d-17fc-4cf5-936f-b2ffcf82355d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:35.090034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ec1d-17fc-4cf5-936f-b2ffcf82355d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:35.091370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 680/1347] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:35.096894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e0e36-7c55-43b2-85f5-817644ff9784 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:35.097353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e0e36-7c55-43b2-85f5-817644ff9784 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:35.097452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e0e36-7c55-43b2-85f5-817644ff9784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:35.117274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f64e0e36-7c55-43b2-85f5-817644ff9784 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:35.118725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f64e0e36-7c55-43b2-85f5-817644ff9784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:35.127483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 668/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:35.165594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ec1d-17fc-4cf5-936f-b2ffcf82355d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:35.178416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ec1d-17fc-4cf5-936f-b2ffcf82355d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:35.182970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc35e87-a6df-4232-a1cb-5f13acc0c51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:35.183616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35e87-a6df-4232-a1cb-5f13acc0c51a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:35.183901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35e87-a6df-4232-a1cb-5f13acc0c51a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:35.184218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35e87-a6df-4232-a1cb-5f13acc0c51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:35.193974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc35e87-a6df-4232-a1cb-5f13acc0c51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:35.195454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc35e87-a6df-4232-a1cb-5f13acc0c51a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:35.206172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 681/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:40.697083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4a053-2cb3-4e78-b299-27a19b17eaaf None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:40.698033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4a053-2cb3-4e78-b299-27a19b17eaaf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:40.698549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4a053-2cb3-4e78-b299-27a19b17eaaf None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:40.700473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 669/1350] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 12:54:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:40.705857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9630-d00a-4b73-bdad-e54c0c6cc57a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:40.706750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9630-d00a-4b73-bdad-e54c0c6cc57a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:40.707275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9630-d00a-4b73-bdad-e54c0c6cc57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:40.785890 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-993f9630-d00a-4b73-bdad-e54c0c6cc57a None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:40.787272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-993f9630-d00a-4b73-bdad-e54c0c6cc57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:40.874989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 682/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:45.110531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=13 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:45.249400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f48f0-efe3-4607-a39c-69c70e8882ed None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:45.250223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f48f0-efe3-4607-a39c-69c70e8882ed None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:45.250565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f48f0-efe3-4607-a39c-69c70e8882ed None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:45.252086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 670/1352] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 12:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:45.258793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb73d1-82fc-4196-8df4-54b0e9cb926d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:45.259347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb73d1-82fc-4196-8df4-54b0e9cb926d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:45.259347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb73d1-82fc-4196-8df4-54b0e9cb926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:45.283360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a1bb73d1-82fc-4196-8df4-54b0e9cb926d None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:45.284999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a1bb73d1-82fc-4196-8df4-54b0e9cb926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:45.296062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 683/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 12:54:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:46.915303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e05f-4940-4f2b-b98e-03244a6e0d7d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:46.915908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e05f-4940-4f2b-b98e-03244a6e0d7d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:46.915908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e05f-4940-4f2b-b98e-03244a6e0d7d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:46.917281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 671/1354] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 12:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:46.923320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef0f4-ffa9-4011-8a20-fa7938779d46 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:46.923925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef0f4-ffa9-4011-8a20-fa7938779d46 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:46.924096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef0f4-ffa9-4011-8a20-fa7938779d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:46.946523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22fef0f4-ffa9-4011-8a20-fa7938779d46 None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:46.947771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22fef0f4-ffa9-4011-8a20-fa7938779d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:46.958281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 684/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 12:54:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:50.913571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72d90-8154-4d50-9551-43a89994241f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:50.914501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72d90-8154-4d50-9551-43a89994241f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:50.914769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72d90-8154-4d50-9551-43a89994241f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:50.916143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 672/1356] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:50.921389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac229a6-0567-40b5-9cc0-ad0dda5e2ca9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:50.921914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac229a6-0567-40b5-9cc0-ad0dda5e2ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:50.921914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac229a6-0567-40b5-9cc0-ad0dda5e2ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:50.939955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bac229a6-0567-40b5-9cc0-ad0dda5e2ca9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:50.941131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bac229a6-0567-40b5-9cc0-ad0dda5e2ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:50.949434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 685/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:51.003671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430f1f-0a39-49da-99a2-fb4b16690900 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:51.004063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430f1f-0a39-49da-99a2-fb4b16690900 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:51.004418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430f1f-0a39-49da-99a2-fb4b16690900 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:51.005991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 673/1358] 10.222.0.58 () {54 vars in 961 bytes} [Fri Jun 3 12:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:51.014018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b97d-c97a-4ffd-ba35-be7d0bc125be None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:51.014339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b97d-c97a-4ffd-ba35-be7d0bc125be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:51.014977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b97d-c97a-4ffd-ba35-be7d0bc125be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:51.062270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:51.072558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1b43b97d-c97a-4ffd-ba35-be7d0bc125be None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:51.074053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1b43b97d-c97a-4ffd-ba35-be7d0bc125be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:51.173637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 686/1359] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Jun 3 12:54:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:51.182348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430f1f-0a39-49da-99a2-fb4b16690900 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:51.198354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430f1f-0a39-49da-99a2-fb4b16690900 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:51.203878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37651da1-c2eb-4275-993e-d856e3072ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:51.204530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651da1-c2eb-4275-993e-d856e3072ffd service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:51.204817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651da1-c2eb-4275-993e-d856e3072ffd service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:51.205098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651da1-c2eb-4275-993e-d856e3072ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:51.219487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37651da1-c2eb-4275-993e-d856e3072ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:51.221439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37651da1-c2eb-4275-993e-d856e3072ffd service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:51.232006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 674/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:53.692748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbab4-0513-4456-a65f-24f703069060 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:53.693250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbab4-0513-4456-a65f-24f703069060 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:53.693357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbab4-0513-4456-a65f-24f703069060 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:53.694857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 687/1361] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:53.700501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193e32-7a22-4f11-bee1-e6a8d0a8b7c3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:53.701479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193e32-7a22-4f11-bee1-e6a8d0a8b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:53.701761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193e32-7a22-4f11-bee1-e6a8d0a8b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:53.719757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a6193e32-7a22-4f11-bee1-e6a8d0a8b7c3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:53.720953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a6193e32-7a22-4f11-bee1-e6a8d0a8b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:53.729358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 675/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:53.773964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbab4-0513-4456-a65f-24f703069060 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:53.789555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbab4-0513-4456-a65f-24f703069060 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:53.795358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5bbc1-a074-40d2-99e7-ebdca6a857d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:53.796075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bbc1-a074-40d2-99e7-ebdca6a857d9 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:53.796424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bbc1-a074-40d2-99e7-ebdca6a857d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:53.796764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bbc1-a074-40d2-99e7-ebdca6a857d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:53.806257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5bbc1-a074-40d2-99e7-ebdca6a857d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:53.808409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5bbc1-a074-40d2-99e7-ebdca6a857d9 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:53.820172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 688/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:56.390739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18939fc7-1773-41c6-9ecf-22489a3576c8 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:56.391638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18939fc7-1773-41c6-9ecf-22489a3576c8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:56.392145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18939fc7-1773-41c6-9ecf-22489a3576c8 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:56.393611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 676/1364] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:56.400286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7f81-117d-4675-a83e-2832990ec436 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:56.401104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7f81-117d-4675-a83e-2832990ec436 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:56.401379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7f81-117d-4675-a83e-2832990ec436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:56.441710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-309f7f81-117d-4675-a83e-2832990ec436 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:56.447611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-309f7f81-117d-4675-a83e-2832990ec436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:56.460943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 689/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:56.509596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a6ce6-ae9f-4b26-ad67-df6afb0b3bf3 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:56.510003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a6ce6-ae9f-4b26-ad67-df6afb0b3bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:56.510460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a6ce6-ae9f-4b26-ad67-df6afb0b3bf3 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:56.512016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 677/1366] 10.222.0.58 () {54 vars in 961 bytes} [Fri Jun 3 12:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:56.517919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a107aee-369d-4236-b4a4-eebea8b1e4da None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:56.518325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a107aee-369d-4236-b4a4-eebea8b1e4da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:56.518690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a107aee-369d-4236-b4a4-eebea8b1e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:56.539681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3a107aee-369d-4236-b4a4-eebea8b1e4da None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:56.541163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3a107aee-369d-4236-b4a4-eebea8b1e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:56.551698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 690/1367] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Jun 3 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:56.561951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a6ce6-ae9f-4b26-ad67-df6afb0b3bf3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:56.576471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a6ce6-ae9f-4b26-ad67-df6afb0b3bf3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:56.582129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec68d4-dff0-42ca-8527-3851b6ea059b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:56.582785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec68d4-dff0-42ca-8527-3851b6ea059b service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:56.583072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec68d4-dff0-42ca-8527-3851b6ea059b service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:56.583351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec68d4-dff0-42ca-8527-3851b6ea059b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:56.591618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec68d4-dff0-42ca-8527-3851b6ea059b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:56.593331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec68d4-dff0-42ca-8527-3851b6ea059b service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:56.602870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 678/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:58.933612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d667f-c518-46a3-80fa-064d1b3b2a03 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:58.934963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d667f-c518-46a3-80fa-064d1b3b2a03 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:58.935629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d667f-c518-46a3-80fa-064d1b3b2a03 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:58.937278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 691/1369] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:58.943198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0111b-1be3-41ed-980e-db2a95f53214 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:58.944644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0111b-1be3-41ed-980e-db2a95f53214 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:58.945360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0111b-1be3-41ed-980e-db2a95f53214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:58.965556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a8b0111b-1be3-41ed-980e-db2a95f53214 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:58.966809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a8b0111b-1be3-41ed-980e-db2a95f53214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:58.976383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 679/1370] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:59.021786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d667f-c518-46a3-80fa-064d1b3b2a03 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:59.037802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d667f-c518-46a3-80fa-064d1b3b2a03 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:59.043542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4d985-8c04-45b9-af36-fa37fcfca0a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:59.044198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d985-8c04-45b9-af36-fa37fcfca0a3 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:59.044482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d985-8c04-45b9-af36-fa37fcfca0a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:59.044762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d985-8c04-45b9-af36-fa37fcfca0a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:59.053956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4d985-8c04-45b9-af36-fa37fcfca0a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:59.055575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4d985-8c04-45b9-af36-fa37fcfca0a3 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:59.065831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 692/1371] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:54:59.197383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b73e8-26d8-4c05-b501-eae8674ea9df None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:59.197596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b73e8-26d8-4c05-b501-eae8674ea9df None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:59.197852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b73e8-26d8-4c05-b501-eae8674ea9df None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:59.200358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 680/1372] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:59.207168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fc4ac-6494-4b91-9fbc-33762035be31 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:59.207599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fc4ac-6494-4b91-9fbc-33762035be31 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:59.207978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fc4ac-6494-4b91-9fbc-33762035be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:59.240775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-093fc4ac-6494-4b91-9fbc-33762035be31 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:59.242517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-093fc4ac-6494-4b91-9fbc-33762035be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:59.252079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 693/1373] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:59.605567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab28d8-38d6-40be-99f8-d92fa0bd6449 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:59.606150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab28d8-38d6-40be-99f8-d92fa0bd6449 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:59.606597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab28d8-38d6-40be-99f8-d92fa0bd6449 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:59.608412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 681/1374] 10.222.0.58 () {54 vars in 963 bytes} [Fri Jun 3 12:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:54:59.613599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e243d-67bd-433a-a8ba-9d0420120e61 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:59.617069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e243d-67bd-433a-a8ba-9d0420120e61 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:59.617672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e243d-67bd-433a-a8ba-9d0420120e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:59.689537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-303e243d-67bd-433a-a8ba-9d0420120e61 None None] MFA Rules not processed for user `30ea8e8f73ad4862a22ca7ce2b461740`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:54:59.691412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-303e243d-67bd-433a-a8ba-9d0420120e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:54:59.766651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 694/1375] 10.222.0.58 () {58 vars in 1060 bytes} [Fri Jun 3 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:54:59.776080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab28d8-38d6-40be-99f8-d92fa0bd6449 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:54:59.788024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab28d8-38d6-40be-99f8-d92fa0bd6449 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:54:59.791699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48877502-6786-487b-935b-b576cd2b54b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:54:59.792547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877502-6786-487b-935b-b576cd2b54b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:54:59.792834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877502-6786-487b-935b-b576cd2b54b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:54:59.793110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877502-6786-487b-935b-b576cd2b54b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:54:59.803053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48877502-6786-487b-935b-b576cd2b54b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:54:59.804674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48877502-6786-487b-935b-b576cd2b54b4 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:54:59.815262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 682/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:01.411666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9843-00c9-4830-a258-f8a5d905987e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:01.412261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9843-00c9-4830-a258-f8a5d905987e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:01.412261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9843-00c9-4830-a258-f8a5d905987e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:01.413609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 695/1377] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:01.419344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8e79-c7f7-4835-a901-c20da679c239 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:01.419787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8e79-c7f7-4835-a901-c20da679c239 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:01.419868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8e79-c7f7-4835-a901-c20da679c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:01.437190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-341c8e79-c7f7-4835-a901-c20da679c239 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:01.438416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-341c8e79-c7f7-4835-a901-c20da679c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:01.448020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 683/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:01.494775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b9843-00c9-4830-a258-f8a5d905987e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:01.511422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b9843-00c9-4830-a258-f8a5d905987e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:01.517329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67805d44-091a-45c3-81d9-44699eec0d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:01.517998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67805d44-091a-45c3-81d9-44699eec0d56 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:01.518327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67805d44-091a-45c3-81d9-44699eec0d56 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:01.518604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67805d44-091a-45c3-81d9-44699eec0d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:01.529288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67805d44-091a-45c3-81d9-44699eec0d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:01.530971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67805d44-091a-45c3-81d9-44699eec0d56 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:01.535431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:55:01.545183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 696/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:03.867194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f88023-d1ea-4f8b-a4d1-d5cdc9ce247a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:03.867771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f88023-d1ea-4f8b-a4d1-d5cdc9ce247a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:03.868870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f88023-d1ea-4f8b-a4d1-d5cdc9ce247a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:03.870414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 684/1380] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:03.876252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea6d1-55b0-48fc-ba40-bde1bbb79273 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:03.876728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea6d1-55b0-48fc-ba40-bde1bbb79273 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:03.876839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea6d1-55b0-48fc-ba40-bde1bbb79273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:03.895312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ec9ea6d1-55b0-48fc-ba40-bde1bbb79273 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:03.896917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ec9ea6d1-55b0-48fc-ba40-bde1bbb79273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:03.905427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 697/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:03.950150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f88023-d1ea-4f8b-a4d1-d5cdc9ce247a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:03.965499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f88023-d1ea-4f8b-a4d1-d5cdc9ce247a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:03.970773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fee97-4196-4acd-bc45-d472904b23f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:03.971415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fee97-4196-4acd-bc45-d472904b23f9 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:03.971698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fee97-4196-4acd-bc45-d472904b23f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:03.971974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fee97-4196-4acd-bc45-d472904b23f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:03.980182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fee97-4196-4acd-bc45-d472904b23f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:03.981834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fee97-4196-4acd-bc45-d472904b23f9 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:03.991552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 685/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:06.304770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b6a1-d547-4477-9520-bb77e89c2116 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:06.305355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b6a1-d547-4477-9520-bb77e89c2116 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:06.305355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b6a1-d547-4477-9520-bb77e89c2116 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:06.306702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 698/1383] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:06.312300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88424-ba92-426d-a760-15ef2570fbc8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:06.312750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88424-ba92-426d-a760-15ef2570fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:06.312881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88424-ba92-426d-a760-15ef2570fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:06.331682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d3a88424-ba92-426d-a760-15ef2570fbc8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:06.333134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d3a88424-ba92-426d-a760-15ef2570fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:06.341055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 686/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:06.392307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1b6a1-d547-4477-9520-bb77e89c2116 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:06.409862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1b6a1-d547-4477-9520-bb77e89c2116 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:06.417139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a61f3-055d-4aed-a004-50a7ee970726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:06.418333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a61f3-055d-4aed-a004-50a7ee970726 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:06.418880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a61f3-055d-4aed-a004-50a7ee970726 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:06.419380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a61f3-055d-4aed-a004-50a7ee970726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:06.430225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a61f3-055d-4aed-a004-50a7ee970726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:06.432359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a61f3-055d-4aed-a004-50a7ee970726 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:06.444801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 699/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:08.753867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5b1c-3075-4eda-9a51-81bd6cb94382 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:08.754989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5b1c-3075-4eda-9a51-81bd6cb94382 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:08.754989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5b1c-3075-4eda-9a51-81bd6cb94382 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:08.755923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 687/1386] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:55:08.761718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b884af-ec71-407e-bf94-b741ad8d3e58 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:08.762426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b884af-ec71-407e-bf94-b741ad8d3e58 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:08.762426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b884af-ec71-407e-bf94-b741ad8d3e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:08.783063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-36b884af-ec71-407e-bf94-b741ad8d3e58 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:08.784302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36b884af-ec71-407e-bf94-b741ad8d3e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:08.793070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 700/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:08.843242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5b1c-3075-4eda-9a51-81bd6cb94382 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:08.859117 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5b1c-3075-4eda-9a51-81bd6cb94382 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:08.864949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b24e-0f88-4d18-b4b7-12020e0a09ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:08.865581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b24e-0f88-4d18-b4b7-12020e0a09ea service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:08.865865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b24e-0f88-4d18-b4b7-12020e0a09ea service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:08.866172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b24e-0f88-4d18-b4b7-12020e0a09ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:08.875372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b24e-0f88-4d18-b4b7-12020e0a09ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:08.877021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b24e-0f88-4d18-b4b7-12020e0a09ea service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:08.887488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 688/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:11.171499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85855-7933-4243-829b-a79356460d3a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:11.172054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85855-7933-4243-829b-a79356460d3a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:11.172418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85855-7933-4243-829b-a79356460d3a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:11.173922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 701/1389] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:11.180319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babb099-de07-4a14-874e-3bb204175c35 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:11.180789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babb099-de07-4a14-874e-3bb204175c35 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:11.180906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babb099-de07-4a14-874e-3bb204175c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:11.199847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1babb099-de07-4a14-874e-3bb204175c35 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:11.201066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1babb099-de07-4a14-874e-3bb204175c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:11.209439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 689/1390] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:11.255383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85855-7933-4243-829b-a79356460d3a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:11.270730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85855-7933-4243-829b-a79356460d3a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:11.277329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d9dbb-9cbb-4942-b1bb-bb80bc0a9838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:11.278008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d9dbb-9cbb-4942-b1bb-bb80bc0a9838 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:11.278324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d9dbb-9cbb-4942-b1bb-bb80bc0a9838 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:11.278604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d9dbb-9cbb-4942-b1bb-bb80bc0a9838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:11.287686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d9dbb-9cbb-4942-b1bb-bb80bc0a9838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:11.289415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d9dbb-9cbb-4942-b1bb-bb80bc0a9838 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:11.299265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 702/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:13.633862 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395b3f-8ea8-4312-b2d7-d043eb8b23b0 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:13.634556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395b3f-8ea8-4312-b2d7-d043eb8b23b0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:13.634556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395b3f-8ea8-4312-b2d7-d043eb8b23b0 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:13.635856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 690/1392] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:13.641444 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb30ff-ba7d-42d7-a420-ededfef4a805 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:13.641960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb30ff-ba7d-42d7-a420-ededfef4a805 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:13.642056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb30ff-ba7d-42d7-a420-ededfef4a805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:13.660856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a1eb30ff-ba7d-42d7-a420-ededfef4a805 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:13.662211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a1eb30ff-ba7d-42d7-a420-ededfef4a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:13.671089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 703/1393] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:13.721909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20395b3f-8ea8-4312-b2d7-d043eb8b23b0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:13.741393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20395b3f-8ea8-4312-b2d7-d043eb8b23b0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:13.749743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1e3d7-be6a-4af3-95c1-b03560aa1110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:13.750709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e3d7-be6a-4af3-95c1-b03560aa1110 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:13.751123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e3d7-be6a-4af3-95c1-b03560aa1110 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:13.751473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e3d7-be6a-4af3-95c1-b03560aa1110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:13.763089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1e3d7-be6a-4af3-95c1-b03560aa1110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:13.765414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1e3d7-be6a-4af3-95c1-b03560aa1110 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:13.778983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 691/1394] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:16.182491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad56cc-efa9-4127-8b7c-784c886b79cc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:16.183463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad56cc-efa9-4127-8b7c-784c886b79cc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:16.183463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad56cc-efa9-4127-8b7c-784c886b79cc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:16.184431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 704/1395] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:16.189892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5101-8064-46a4-9421-2a894b57d687 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:16.190697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5101-8064-46a4-9421-2a894b57d687 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:16.190697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5101-8064-46a4-9421-2a894b57d687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:16.199029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=52 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:55:16.214434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bb4f5101-8064-46a4-9421-2a894b57d687 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:16.216000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bb4f5101-8064-46a4-9421-2a894b57d687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:16.226900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 692/1396] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:16.274367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad56cc-efa9-4127-8b7c-784c886b79cc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:16.289998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad56cc-efa9-4127-8b7c-784c886b79cc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:16.296113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789057c6-83f1-40ef-92fd-330f617ab24a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:16.296764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789057c6-83f1-40ef-92fd-330f617ab24a service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:16.297048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789057c6-83f1-40ef-92fd-330f617ab24a service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:16.297328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789057c6-83f1-40ef-92fd-330f617ab24a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:16.307602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789057c6-83f1-40ef-92fd-330f617ab24a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:16.309218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789057c6-83f1-40ef-92fd-330f617ab24a service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:16.319451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 705/1397] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:18.477105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c526b-3563-420b-b0be-4503272f2688 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.477742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c526b-3563-420b-b0be-4503272f2688 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.477742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c526b-3563-420b-b0be-4503272f2688 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.479128 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 693/1398] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:18.484584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629c49-9330-4a55-bed2-abc5f3049cc3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.485027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629c49-9330-4a55-bed2-abc5f3049cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.485184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629c49-9330-4a55-bed2-abc5f3049cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.504933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f2629c49-9330-4a55-bed2-abc5f3049cc3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:18.506145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2629c49-9330-4a55-bed2-abc5f3049cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:18.515039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 706/1399] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:18.570671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9da93-3851-4f18-b89f-e69fb831cf58 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.570965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9da93-3851-4f18-b89f-e69fb831cf58 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.571247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9da93-3851-4f18-b89f-e69fb831cf58 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.572636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 694/1400] 10.222.0.58 () {54 vars in 962 bytes} [Fri Jun 3 12:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:18.577716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cfd87-5e15-4b42-9d2c-09b7bf6c6736 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.578005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cfd87-5e15-4b42-9d2c-09b7bf6c6736 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.578326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cfd87-5e15-4b42-9d2c-09b7bf6c6736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.633376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da191114-b34c-41c4-a268-18d38cd26052 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.633658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da191114-b34c-41c4-a268-18d38cd26052 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.633893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da191114-b34c-41c4-a268-18d38cd26052 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.635328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 695/1401] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:18.640465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411a538-ca8f-4847-acff-d628d72e3487 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.640723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411a538-ca8f-4847-acff-d628d72e3487 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.641029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411a538-ca8f-4847-acff-d628d72e3487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.645885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c98cfd87-5e15-4b42-9d2c-09b7bf6c6736 None None] MFA Rules not processed for user `58ea8ab7aaf7415ea86a0975dfe54a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:18.647158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c98cfd87-5e15-4b42-9d2c-09b7bf6c6736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:18.660065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0411a538-ca8f-4847-acff-d628d72e3487 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:18.661260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0411a538-ca8f-4847-acff-d628d72e3487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:18.670283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 696/1402] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:55:18.706538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 707/1403] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Jun 3 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:18.714571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411a538-ca8f-4847-acff-d628d72e3487 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:18.715458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cfd87-5e15-4b42-9d2c-09b7bf6c6736 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:18.724053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411a538-ca8f-4847-acff-d628d72e3487 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:18.727717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba5126-1bd9-41fb-801a-b53be55ef1b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:18.728299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5126-1bd9-41fb-801a-b53be55ef1b8 service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.728570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cfd87-5e15-4b42-9d2c-09b7bf6c6736 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:18.728702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5126-1bd9-41fb-801a-b53be55ef1b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.728852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5126-1bd9-41fb-801a-b53be55ef1b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.734564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc884cf-8515-4766-8ee6-0ecfd02b63f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:18.735212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc884cf-8515-4766-8ee6-0ecfd02b63f1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:18.735496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc884cf-8515-4766-8ee6-0ecfd02b63f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:18.735772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc884cf-8515-4766-8ee6-0ecfd02b63f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:18.741006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba5126-1bd9-41fb-801a-b53be55ef1b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:18.742532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba5126-1bd9-41fb-801a-b53be55ef1b8 service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:18.744188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc884cf-8515-4766-8ee6-0ecfd02b63f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:18.745774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc884cf-8515-4766-8ee6-0ecfd02b63f1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:18.752456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 697/1404] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:18.755700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 708/1405] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:19.298167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2632ef-8a78-453a-a474-aacd0367844f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:19.298463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2632ef-8a78-453a-a474-aacd0367844f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:19.298743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2632ef-8a78-453a-a474-aacd0367844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:19.359486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8d2632ef-8a78-453a-a474-aacd0367844f None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:19.360739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8d2632ef-8a78-453a-a474-aacd0367844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:19.431944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 698/1406] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:19.478713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28495f-7243-4d8a-b77c-90729ee1d2c8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:19.479000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28495f-7243-4d8a-b77c-90729ee1d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:19.479268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28495f-7243-4d8a-b77c-90729ee1d2c8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:19.480647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 709/1407] 10.222.0.58 () {54 vars in 942 bytes} [Fri Jun 3 12:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:19.487099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50974cbd-b9ac-4164-a4ac-c8fbaec332a3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:19.487617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50974cbd-b9ac-4164-a4ac-c8fbaec332a3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:19.487803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50974cbd-b9ac-4164-a4ac-c8fbaec332a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:19.538843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-50974cbd-b9ac-4164-a4ac-c8fbaec332a3 None None] MFA Rules not processed for user `770bb4d411374e3daddba2cdf48c3c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:19.539981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-50974cbd-b9ac-4164-a4ac-c8fbaec332a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:19.612940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 699/1408] 10.222.0.58 () {58 vars in 1039 bytes} [Fri Jun 3 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:19.622394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28495f-7243-4d8a-b77c-90729ee1d2c8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:19.636771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28495f-7243-4d8a-b77c-90729ee1d2c8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:19.642159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87609de8-ab20-4245-89fe-43a55ff3b71a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:19.642811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87609de8-ab20-4245-89fe-43a55ff3b71a service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:19.643087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87609de8-ab20-4245-89fe-43a55ff3b71a service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:19.643357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87609de8-ab20-4245-89fe-43a55ff3b71a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:19.651868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87609de8-ab20-4245-89fe-43a55ff3b71a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:19.653443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87609de8-ab20-4245-89fe-43a55ff3b71a service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:19.661552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 710/1409] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 12:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:55:29.609758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:55:29.658293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:55:43.066666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb11a1-90a3-4b62-8b97-bf5b334a275b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:43.067623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb11a1-90a3-4b62-8b97-bf5b334a275b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:43.067623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb11a1-90a3-4b62-8b97-bf5b334a275b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:43.069639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 700/1410] 10.222.0.58 () {54 vars in 918 bytes} [Fri Jun 3 12:55:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:43.077708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20cfc-2e96-4616-a898-486b05478757 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:43.078203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20cfc-2e96-4616-a898-486b05478757 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:43.078314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20cfc-2e96-4616-a898-486b05478757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:43.098403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d2c20cfc-2e96-4616-a898-486b05478757 None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:43.099613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d2c20cfc-2e96-4616-a898-486b05478757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:43.109052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 711/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jun 3 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:43.124136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcebadd-4252-4fde-8d1e-e8d37af0f1d4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:43.124431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcebadd-4252-4fde-8d1e-e8d37af0f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:43.124713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcebadd-4252-4fde-8d1e-e8d37af0f1d4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:43.126090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 701/1412] 10.222.0.58 () {54 vars in 918 bytes} [Fri Jun 3 12:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:43.131749 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae005b-c85e-4c00-a189-a3a05959e48e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:43.132285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae005b-c85e-4c00-a189-a3a05959e48e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:43.132659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae005b-c85e-4c00-a189-a3a05959e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:43.153714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c0ae005b-c85e-4c00-a189-a3a05959e48e None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:43.154935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c0ae005b-c85e-4c00-a189-a3a05959e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:43.166783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 712/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jun 3 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:55:45.917364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11116b66-d7a5-4880-acb3-f7f642cb2e61 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:45.918268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11116b66-d7a5-4880-acb3-f7f642cb2e61 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:45.918268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11116b66-d7a5-4880-acb3-f7f642cb2e61 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:45.920365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:55:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:45.927766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adac0d-9a3b-4b03-bbd3-940cec79856f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:45.928175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adac0d-9a3b-4b03-bbd3-940cec79856f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:45.928328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adac0d-9a3b-4b03-bbd3-940cec79856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:45.946500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-42adac0d-9a3b-4b03-bbd3-940cec79856f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:45.947686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42adac0d-9a3b-4b03-bbd3-940cec79856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:45.956831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:46.005169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11116b66-d7a5-4880-acb3-f7f642cb2e61 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:46.020912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11116b66-d7a5-4880-acb3-f7f642cb2e61 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:46.026689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd9d6b-753a-4fca-a8eb-cba3733f46d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:46.027333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9d6b-753a-4fca-a8eb-cba3733f46d2 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:46.027616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9d6b-753a-4fca-a8eb-cba3733f46d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:46.027893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9d6b-753a-4fca-a8eb-cba3733f46d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:46.036676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd9d6b-753a-4fca-a8eb-cba3733f46d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:46.038364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd9d6b-753a-4fca-a8eb-cba3733f46d2 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:46.047855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 703/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:47.032843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c372b-d8b7-4517-9f30-2ae3ed75b6d0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:47.033826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c372b-d8b7-4517-9f30-2ae3ed75b6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:47.033937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c372b-d8b7-4517-9f30-2ae3ed75b6d0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:47.035900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:47.041982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb76fe-f652-4a1f-b5ba-967bbb6f073f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:47.042485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb76fe-f652-4a1f-b5ba-967bbb6f073f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:47.042591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb76fe-f652-4a1f-b5ba-967bbb6f073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:47.069570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fbeb76fe-f652-4a1f-b5ba-967bbb6f073f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:47.070835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fbeb76fe-f652-4a1f-b5ba-967bbb6f073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:47.080277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:47.257673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c372b-d8b7-4517-9f30-2ae3ed75b6d0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:47.275893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c372b-d8b7-4517-9f30-2ae3ed75b6d0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:47.281588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d6a01-eb7b-4ebd-9020-4579c9ac3c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:47.282260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d6a01-eb7b-4ebd-9020-4579c9ac3c08 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:47.282522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d6a01-eb7b-4ebd-9020-4579c9ac3c08 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:47.282815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d6a01-eb7b-4ebd-9020-4579c9ac3c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:47.292367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d6a01-eb7b-4ebd-9020-4579c9ac3c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:47.294308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d6a01-eb7b-4ebd-9020-4579c9ac3c08 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:47.305353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 715/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:48.257332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f852f-69eb-4ac8-a741-aa21c3cf02e1 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:48.258292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f852f-69eb-4ac8-a741-aa21c3cf02e1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:48.258292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f852f-69eb-4ac8-a741-aa21c3cf02e1 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:48.260444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:48.268650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd21bae-b6ef-4231-b52f-88cce7a770d0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:48.269105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd21bae-b6ef-4231-b52f-88cce7a770d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:48.269401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd21bae-b6ef-4231-b52f-88cce7a770d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:48.294662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1fd21bae-b6ef-4231-b52f-88cce7a770d0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:48.295904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1fd21bae-b6ef-4231-b52f-88cce7a770d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:48.304428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:48.457985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f852f-69eb-4ac8-a741-aa21c3cf02e1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:48.478920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f852f-69eb-4ac8-a741-aa21c3cf02e1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:48.485790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02dae-ebaf-4162-9b56-034a9b954570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:48.486492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02dae-ebaf-4162-9b56-034a9b954570 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:48.486778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02dae-ebaf-4162-9b56-034a9b954570 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:48.487274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02dae-ebaf-4162-9b56-034a9b954570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:48.496917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02dae-ebaf-4162-9b56-034a9b954570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:48.498561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02dae-ebaf-4162-9b56-034a9b954570 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:48.508392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 706/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:49.422941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9a682-6a35-49dc-8296-6b8f5fd461c0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:49.423850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9a682-6a35-49dc-8296-6b8f5fd461c0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:49.423850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9a682-6a35-49dc-8296-6b8f5fd461c0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:49.425908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:49.432239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13176ba-f081-4167-9752-031d39bc99d7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:49.432707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13176ba-f081-4167-9752-031d39bc99d7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:49.432816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13176ba-f081-4167-9752-031d39bc99d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:49.459496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c13176ba-f081-4167-9752-031d39bc99d7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:49.460718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c13176ba-f081-4167-9752-031d39bc99d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:49.469831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:49.623681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9a682-6a35-49dc-8296-6b8f5fd461c0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:49.648371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9a682-6a35-49dc-8296-6b8f5fd461c0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:49.655173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5a65a-f57f-4757-9984-efb4ba4a2692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:49.655853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a65a-f57f-4757-9984-efb4ba4a2692 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:49.656137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a65a-f57f-4757-9984-efb4ba4a2692 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:49.656408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5a65a-f57f-4757-9984-efb4ba4a2692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:49.665394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5a65a-f57f-4757-9984-efb4ba4a2692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:49.667030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5a65a-f57f-4757-9984-efb4ba4a2692 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:49.676961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 718/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:50.664986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a049-84db-4f2f-9c2f-f43def7d2773 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:50.665552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a049-84db-4f2f-9c2f-f43def7d2773 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:50.665552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a049-84db-4f2f-9c2f-f43def7d2773 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:50.666965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:50.680629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118efa-92b9-4753-acf3-1c293030a1cd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:50.681167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118efa-92b9-4753-acf3-1c293030a1cd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:50.681167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118efa-92b9-4753-acf3-1c293030a1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:50.701621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-26118efa-92b9-4753-acf3-1c293030a1cd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:50.702903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-26118efa-92b9-4753-acf3-1c293030a1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:50.712609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:55:50.866641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664a049-84db-4f2f-9c2f-f43def7d2773 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:50.894175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664a049-84db-4f2f-9c2f-f43def7d2773 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:50.901010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5e7a5-5006-4d7a-bb11-6488bd81a425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:50.901816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5e7a5-5006-4d7a-bb11-6488bd81a425 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:50.902154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5e7a5-5006-4d7a-bb11-6488bd81a425 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:50.902428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5e7a5-5006-4d7a-bb11-6488bd81a425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:50.913317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5e7a5-5006-4d7a-bb11-6488bd81a425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:50.914975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5e7a5-5006-4d7a-bb11-6488bd81a425 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:50.924990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 709/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:51.805943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0676a2-21ac-47fd-9e4a-fc6ce5c27314 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:51.806526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0676a2-21ac-47fd-9e4a-fc6ce5c27314 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:51.806526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0676a2-21ac-47fd-9e4a-fc6ce5c27314 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:51.807837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:55:51.814054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47e9e8-06dc-4c0f-9ee3-e7cfbb0529ab None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:51.814936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47e9e8-06dc-4c0f-9ee3-e7cfbb0529ab None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:51.814936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47e9e8-06dc-4c0f-9ee3-e7cfbb0529ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:51.840951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5a47e9e8-06dc-4c0f-9ee3-e7cfbb0529ab None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:51.842187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5a47e9e8-06dc-4c0f-9ee3-e7cfbb0529ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:51.851693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:52.003612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0676a2-21ac-47fd-9e4a-fc6ce5c27314 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:52.020520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0676a2-21ac-47fd-9e4a-fc6ce5c27314 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:52.027431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3d7f-a531-4116-90be-5a0705bfa13b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:52.028070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3d7f-a531-4116-90be-5a0705bfa13b service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:52.028355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3d7f-a531-4116-90be-5a0705bfa13b service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:52.028637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3d7f-a531-4116-90be-5a0705bfa13b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:52.037095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3d7f-a531-4116-90be-5a0705bfa13b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:52.038732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3d7f-a531-4116-90be-5a0705bfa13b service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:52.048052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 721/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:52.932410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1157dd-7b2e-40f2-bd2c-1f62ab39312b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:52.933265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1157dd-7b2e-40f2-bd2c-1f62ab39312b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:52.933265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1157dd-7b2e-40f2-bd2c-1f62ab39312b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:52.935640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:52.941467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0754-e5d9-42dd-ab81-9d9cb18706d0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:52.941932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0754-e5d9-42dd-ab81-9d9cb18706d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:52.942027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0754-e5d9-42dd-ab81-9d9cb18706d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:52.962743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-793a0754-e5d9-42dd-ab81-9d9cb18706d0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:52.963962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-793a0754-e5d9-42dd-ab81-9d9cb18706d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:52.974839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:53.140039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1157dd-7b2e-40f2-bd2c-1f62ab39312b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:53.155980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1157dd-7b2e-40f2-bd2c-1f62ab39312b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:53.163562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cc8ad-899a-4abd-a1e1-f3cb8c62dc34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:53.164214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cc8ad-899a-4abd-a1e1-f3cb8c62dc34 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:53.164622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cc8ad-899a-4abd-a1e1-f3cb8c62dc34 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:53.164905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cc8ad-899a-4abd-a1e1-f3cb8c62dc34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:53.174247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cc8ad-899a-4abd-a1e1-f3cb8c62dc34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:53.176038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cc8ad-899a-4abd-a1e1-f3cb8c62dc34 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:53.186225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 712/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:54.041679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80313e1b-7085-4a61-a625-3ed7a7e84618 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:54.042644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80313e1b-7085-4a61-a625-3ed7a7e84618 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:54.042644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80313e1b-7085-4a61-a625-3ed7a7e84618 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:54.044832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:54.050143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d34e-9c87-4fd0-802b-be4efff56227 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:54.050598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d34e-9c87-4fd0-802b-be4efff56227 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:54.050706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d34e-9c87-4fd0-802b-be4efff56227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:54.070370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9480d34e-9c87-4fd0-802b-be4efff56227 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:54.071574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9480d34e-9c87-4fd0-802b-be4efff56227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:54.084492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:54.238122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80313e1b-7085-4a61-a625-3ed7a7e84618 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:54.254707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80313e1b-7085-4a61-a625-3ed7a7e84618 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:54.260233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c789-da54-457a-a24b-7d1a08dea539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:54.260867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c789-da54-457a-a24b-7d1a08dea539 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:54.261150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c789-da54-457a-a24b-7d1a08dea539 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:54.261428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c789-da54-457a-a24b-7d1a08dea539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:54.270687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c789-da54-457a-a24b-7d1a08dea539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:54.272292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c789-da54-457a-a24b-7d1a08dea539 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:54.282522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 724/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:55.142500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8108-4b1c-4e87-9d1f-918ba13da6e4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:55.143052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8108-4b1c-4e87-9d1f-918ba13da6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:55.143052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8108-4b1c-4e87-9d1f-918ba13da6e4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:55.144643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 12:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:55.149856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d208a-419c-442a-b39e-b9d44f5b3a32 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:55.150369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d208a-419c-442a-b39e-b9d44f5b3a32 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:55.150481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d208a-419c-442a-b39e-b9d44f5b3a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:55.171832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f05d208a-419c-442a-b39e-b9d44f5b3a32 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:55.173039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f05d208a-419c-442a-b39e-b9d44f5b3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:55.183047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:55.336794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8108-4b1c-4e87-9d1f-918ba13da6e4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:55.352025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8108-4b1c-4e87-9d1f-918ba13da6e4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:55.358000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b146f89-cb06-4204-a283-4ba7345ad1e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:55.358650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b146f89-cb06-4204-a283-4ba7345ad1e4 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:55.358949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b146f89-cb06-4204-a283-4ba7345ad1e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:55.359222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b146f89-cb06-4204-a283-4ba7345ad1e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:55.368215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b146f89-cb06-4204-a283-4ba7345ad1e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:55.369806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b146f89-cb06-4204-a283-4ba7345ad1e4 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:55.380066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 715/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:57.585985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd21eb-e0bc-47a4-816a-787b681cb708 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:57.586913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd21eb-e0bc-47a4-816a-787b681cb708 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:57.586913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd21eb-e0bc-47a4-816a-787b681cb708 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:57.589258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:55:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:55:57.595938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b332a-5121-496c-b6e2-51bfce73f902 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:57.596783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b332a-5121-496c-b6e2-51bfce73f902 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:57.596783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b332a-5121-496c-b6e2-51bfce73f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:57.621761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b08b332a-5121-496c-b6e2-51bfce73f902 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:55:57.623027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b08b332a-5121-496c-b6e2-51bfce73f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:57.632941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:55:57.677168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd21eb-e0bc-47a4-816a-787b681cb708 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:55:57.680297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3fbd21eb-e0bc-47a4-816a-787b681cb708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:55:57.703628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd21eb-e0bc-47a4-816a-787b681cb708 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:55:57.709201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e72b9-d4c6-4d9a-8f0b-2cc3228f087b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:55:57.709852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e72b9-d4c6-4d9a-8f0b-2cc3228f087b service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:55:57.710159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e72b9-d4c6-4d9a-8f0b-2cc3228f087b service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:55:57.710439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e72b9-d4c6-4d9a-8f0b-2cc3228f087b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:55:57.720561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e72b9-d4c6-4d9a-8f0b-2cc3228f087b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:55:57.722508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e72b9-d4c6-4d9a-8f0b-2cc3228f087b service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:55:57.732312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 727/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:56:00.145168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa419c0-41a5-4beb-8700-266d496dd8b3 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:00.146077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa419c0-41a5-4beb-8700-266d496dd8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:00.146077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa419c0-41a5-4beb-8700-266d496dd8b3 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:00.148315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:00.153983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9accaf-a6ce-4fbf-9cb1-efb1295bb8fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:00.154440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9accaf-a6ce-4fbf-9cb1-efb1295bb8fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:00.154536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9accaf-a6ce-4fbf-9cb1-efb1295bb8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:00.176410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea9accaf-a6ce-4fbf-9cb1-efb1295bb8fa None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:00.177614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea9accaf-a6ce-4fbf-9cb1-efb1295bb8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:00.187158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:00.235868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa419c0-41a5-4beb-8700-266d496dd8b3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:00.254602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa419c0-41a5-4beb-8700-266d496dd8b3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:00.259146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced5c87-79f8-49cc-8db5-bb414cbc9f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:00.259791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced5c87-79f8-49cc-8db5-bb414cbc9f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:00.260069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced5c87-79f8-49cc-8db5-bb414cbc9f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:00.260341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced5c87-79f8-49cc-8db5-bb414cbc9f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:00.270361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced5c87-79f8-49cc-8db5-bb414cbc9f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:00.271804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced5c87-79f8-49cc-8db5-bb414cbc9f3d service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:00.281603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 718/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:02.921593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249773-aa47-44f5-ab4e-8caeb51c9d03 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:02.922569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249773-aa47-44f5-ab4e-8caeb51c9d03 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:02.922569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249773-aa47-44f5-ab4e-8caeb51c9d03 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:02.924731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:02.930549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c00b-f123-4fb8-9736-d964ce70080b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:02.930979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c00b-f123-4fb8-9736-d964ce70080b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:02.931087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c00b-f123-4fb8-9736-d964ce70080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:02.951916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a107c00b-f123-4fb8-9736-d964ce70080b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:02.953115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a107c00b-f123-4fb8-9736-d964ce70080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:02.962535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:03.001622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249773-aa47-44f5-ab4e-8caeb51c9d03 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:03.015780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249773-aa47-44f5-ab4e-8caeb51c9d03 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:03.020886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e682-e277-4657-bdbf-86dff6ef14ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:03.021621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e682-e277-4657-bdbf-86dff6ef14ff service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:03.021908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e682-e277-4657-bdbf-86dff6ef14ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:03.022243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e682-e277-4657-bdbf-86dff6ef14ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:03.032016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e682-e277-4657-bdbf-86dff6ef14ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:03.033600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e682-e277-4657-bdbf-86dff6ef14ff service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:03.043472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 730/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:05.427199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afaff-d45b-4550-821a-6e97abd71e18 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:05.427844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afaff-d45b-4550-821a-6e97abd71e18 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:05.427844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afaff-d45b-4550-821a-6e97abd71e18 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:05.429151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:05.435765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baa80b-f526-4612-a064-4b69554ef426 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:05.436497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baa80b-f526-4612-a064-4b69554ef426 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:05.436729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baa80b-f526-4612-a064-4b69554ef426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:05.457450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-77baa80b-f526-4612-a064-4b69554ef426 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:05.458697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-77baa80b-f526-4612-a064-4b69554ef426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:05.467137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:05.507090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afaff-d45b-4550-821a-6e97abd71e18 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:05.519555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afaff-d45b-4550-821a-6e97abd71e18 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:05.524048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a875-d722-4f10-a425-307077847ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:05.524689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a875-d722-4f10-a425-307077847ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:05.524981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a875-d722-4f10-a425-307077847ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:05.525248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a875-d722-4f10-a425-307077847ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:05.535350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416a875-d722-4f10-a425-307077847ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:05.536804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416a875-d722-4f10-a425-307077847ef2 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:05.547089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 721/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:56:07.969829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849420-849d-47f6-93f9-cd33e39daa65 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:07.970476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849420-849d-47f6-93f9-cd33e39daa65 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:07.970476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849420-849d-47f6-93f9-cd33e39daa65 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:07.971848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:07.978477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bfcf2-6f70-4461-be0e-c18fef47fb52 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:07.979224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bfcf2-6f70-4461-be0e-c18fef47fb52 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:07.979414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bfcf2-6f70-4461-be0e-c18fef47fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:08.003555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-eb1bfcf2-6f70-4461-be0e-c18fef47fb52 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:08.004774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-eb1bfcf2-6f70-4461-be0e-c18fef47fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:08.013135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:08.051304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849420-849d-47f6-93f9-cd33e39daa65 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:08.063101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849420-849d-47f6-93f9-cd33e39daa65 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:08.067922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d22571-c40c-43de-aa06-41e1d98bb6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:08.068563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d22571-c40c-43de-aa06-41e1d98bb6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:08.068869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d22571-c40c-43de-aa06-41e1d98bb6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:08.069139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d22571-c40c-43de-aa06-41e1d98bb6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:08.079937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d22571-c40c-43de-aa06-41e1d98bb6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:08.081380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d22571-c40c-43de-aa06-41e1d98bb6b5 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:08.091669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 733/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:56:10.401857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172db46-261e-4836-b069-a723ed8d8445 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:10.402513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172db46-261e-4836-b069-a723ed8d8445 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:10.402513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172db46-261e-4836-b069-a723ed8d8445 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:10.403833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:10.409442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb02d0-ca43-4260-ad27-5ed060d88ef4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:10.409898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb02d0-ca43-4260-ad27-5ed060d88ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:10.410004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb02d0-ca43-4260-ad27-5ed060d88ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:10.417027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=70 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:56:10.430497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0edb02d0-ca43-4260-ad27-5ed060d88ef4 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:10.431709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0edb02d0-ca43-4260-ad27-5ed060d88ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:10.440664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:10.482550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172db46-261e-4836-b069-a723ed8d8445 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:10.489206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=64 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:56:10.495959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172db46-261e-4836-b069-a723ed8d8445 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:10.499597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795467b-e784-46b8-bbcc-3868050e2784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:10.500243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795467b-e784-46b8-bbcc-3868050e2784 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:10.500528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795467b-e784-46b8-bbcc-3868050e2784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:10.500803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795467b-e784-46b8-bbcc-3868050e2784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:10.510420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795467b-e784-46b8-bbcc-3868050e2784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:10.511856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795467b-e784-46b8-bbcc-3868050e2784 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:10.521846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 724/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:12.885611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f97f-899e-4df5-80ba-8112f4318673 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:12.886253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f97f-899e-4df5-80ba-8112f4318673 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:12.886253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f97f-899e-4df5-80ba-8112f4318673 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:12.887574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:12.893424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306067-f5c0-4043-95c2-9392df0983fd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:12.893901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306067-f5c0-4043-95c2-9392df0983fd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:12.894029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306067-f5c0-4043-95c2-9392df0983fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:12.913055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3d306067-f5c0-4043-95c2-9392df0983fd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:12.914308 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3d306067-f5c0-4043-95c2-9392df0983fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:12.923348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:12.963140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f97f-899e-4df5-80ba-8112f4318673 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:12.975472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f97f-899e-4df5-80ba-8112f4318673 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:12.979479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51549-6efc-43e0-a02b-abbe30b85a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:12.980119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51549-6efc-43e0-a02b-abbe30b85a87 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:12.980406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51549-6efc-43e0-a02b-abbe30b85a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:12.980686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51549-6efc-43e0-a02b-abbe30b85a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:12.990453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d51549-6efc-43e0-a02b-abbe30b85a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:12.991962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d51549-6efc-43e0-a02b-abbe30b85a87 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:13.002759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 736/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:15.284429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d80098-9bd1-4804-97cb-c322a6f9e48c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:15.284920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d80098-9bd1-4804-97cb-c322a6f9e48c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:15.285040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d80098-9bd1-4804-97cb-c322a6f9e48c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:15.287213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:15.296104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b7569-37a8-4bea-91f4-b7a1c8ea79a1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:15.296540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b7569-37a8-4bea-91f4-b7a1c8ea79a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:15.296659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b7569-37a8-4bea-91f4-b7a1c8ea79a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:15.321885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-609b7569-37a8-4bea-91f4-b7a1c8ea79a1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:15.323134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-609b7569-37a8-4bea-91f4-b7a1c8ea79a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:15.332750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:15.370282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d80098-9bd1-4804-97cb-c322a6f9e48c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:15.382899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d80098-9bd1-4804-97cb-c322a6f9e48c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:15.386969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305216e-8f32-4101-8c66-1c691d488d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:15.387619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305216e-8f32-4101-8c66-1c691d488d98 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:15.387904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305216e-8f32-4101-8c66-1c691d488d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:15.388182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305216e-8f32-4101-8c66-1c691d488d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:15.397931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305216e-8f32-4101-8c66-1c691d488d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:15.399441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305216e-8f32-4101-8c66-1c691d488d98 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:15.409181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 727/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:17.666134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae97f-11d1-4eea-8c3a-45b719f2005e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:17.666745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae97f-11d1-4eea-8c3a-45b719f2005e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:17.666745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae97f-11d1-4eea-8c3a-45b719f2005e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:17.668071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:17.673736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ac13-c382-4c11-a2a9-150117f65180 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:17.674218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ac13-c382-4c11-a2a9-150117f65180 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:17.674327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ac13-c382-4c11-a2a9-150117f65180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:17.693959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0f72ac13-c382-4c11-a2a9-150117f65180 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:17.695193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0f72ac13-c382-4c11-a2a9-150117f65180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:17.703926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:17.745915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae97f-11d1-4eea-8c3a-45b719f2005e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:17.757828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae97f-11d1-4eea-8c3a-45b719f2005e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:17.761660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d65c9a-4027-462b-8879-321bf0669614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:17.762320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d65c9a-4027-462b-8879-321bf0669614 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:17.762608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d65c9a-4027-462b-8879-321bf0669614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:17.762884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d65c9a-4027-462b-8879-321bf0669614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:17.772678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d65c9a-4027-462b-8879-321bf0669614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:17.774132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d65c9a-4027-462b-8879-321bf0669614 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:17.784441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 739/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:20.062320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fd1a1-dae1-409d-8d33-c5ba272fcd91 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:20.062966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fd1a1-dae1-409d-8d33-c5ba272fcd91 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:20.063311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fd1a1-dae1-409d-8d33-c5ba272fcd91 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:20.064865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 12:56:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:20.070433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241dd3-d398-4d4d-bc30-46802410cd72 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:20.070872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241dd3-d398-4d4d-bc30-46802410cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:20.070988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241dd3-d398-4d4d-bc30-46802410cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:20.089754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9a241dd3-d398-4d4d-bc30-46802410cd72 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:20.091002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9a241dd3-d398-4d4d-bc30-46802410cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:20.099455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 12:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:20.138932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fd1a1-dae1-409d-8d33-c5ba272fcd91 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:20.152441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fd1a1-dae1-409d-8d33-c5ba272fcd91 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:20.156677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aea1f4-3cd0-49ff-93b3-c4e1e7875bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:20.157393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea1f4-3cd0-49ff-93b3-c4e1e7875bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:20.157675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea1f4-3cd0-49ff-93b3-c4e1e7875bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:20.157952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea1f4-3cd0-49ff-93b3-c4e1e7875bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:20.168028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aea1f4-3cd0-49ff-93b3-c4e1e7875bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:20.169452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aea1f4-3cd0-49ff-93b3-c4e1e7875bb3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:20.179854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 730/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:30.084619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=20 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:56:30.175188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=23 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:56:51.848125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665d2f4-4446-4bf0-9a54-8b97d0ee8a41 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:51.848699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665d2f4-4446-4bf0-9a54-8b97d0ee8a41 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:51.848699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665d2f4-4446-4bf0-9a54-8b97d0ee8a41 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:51.850611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 741/1471] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:51.859197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572d94-4cee-48ea-8770-f1745f7bc514 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:51.859610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572d94-4cee-48ea-8770-f1745f7bc514 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:51.859748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572d94-4cee-48ea-8770-f1745f7bc514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:51.880195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0c572d94-4cee-48ea-8770-f1745f7bc514 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:51.881393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0c572d94-4cee-48ea-8770-f1745f7bc514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:51.890314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 731/1472] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:51.939245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32be0-0c3c-425b-90d8-82328b830940 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:51.939537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32be0-0c3c-425b-90d8-82328b830940 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:51.939816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32be0-0c3c-425b-90d8-82328b830940 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:51.941189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 742/1473] 10.222.0.58 () {54 vars in 962 bytes} [Fri Jun 3 12:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:51.946027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d758d1-f325-4919-8cc0-9c016981f1ff None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:51.946346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d758d1-f325-4919-8cc0-9c016981f1ff None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:51.946629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d758d1-f325-4919-8cc0-9c016981f1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:51.967145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-67d758d1-f325-4919-8cc0-9c016981f1ff None None] MFA Rules not processed for user `58ea8ab7aaf7415ea86a0975dfe54a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:51.968338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-67d758d1-f325-4919-8cc0-9c016981f1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:51.976417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 732/1474] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Jun 3 12:56:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:51.984152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd32be0-0c3c-425b-90d8-82328b830940 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:51.996938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd32be0-0c3c-425b-90d8-82328b830940 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:52.001529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2870aeb-4fe8-41a5-94ea-2e3270bdf0a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:52.002167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870aeb-4fe8-41a5-94ea-2e3270bdf0a6 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:52.002489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870aeb-4fe8-41a5-94ea-2e3270bdf0a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:52.002774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870aeb-4fe8-41a5-94ea-2e3270bdf0a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:52.012645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2870aeb-4fe8-41a5-94ea-2e3270bdf0a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:52.014339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2870aeb-4fe8-41a5-94ea-2e3270bdf0a6 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:52.025012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 743/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:54.400369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfc3fe-c65c-45ee-9435-069389d94a69 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:54.401224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfc3fe-c65c-45ee-9435-069389d94a69 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:54.401397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfc3fe-c65c-45ee-9435-069389d94a69 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:54.403767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 733/1476] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:56:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:54.410259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b77ea-4061-4718-a67f-8ad8e5e80649 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:54.410732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b77ea-4061-4718-a67f-8ad8e5e80649 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:54.410835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b77ea-4061-4718-a67f-8ad8e5e80649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:54.437345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-655b77ea-4061-4718-a67f-8ad8e5e80649 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:54.438578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-655b77ea-4061-4718-a67f-8ad8e5e80649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:54.447253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 744/1477] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:54.471316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfc3fe-c65c-45ee-9435-069389d94a69 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:54.491617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfc3fe-c65c-45ee-9435-069389d94a69 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:54.499807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a011b0-508d-4ae4-8a81-c010bc47f510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:54.500476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a011b0-508d-4ae4-8a81-c010bc47f510 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:54.500756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a011b0-508d-4ae4-8a81-c010bc47f510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:54.501035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a011b0-508d-4ae4-8a81-c010bc47f510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:54.501778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a011b0-508d-4ae4-8a81-c010bc47f510 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:54.503690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-46a011b0-508d-4ae4-8a81-c010bc47f510 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:56:54.503690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 12:56:54.503690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 12:56:54.504866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a011b0-508d-4ae4-8a81-c010bc47f510 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:54.525944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 734/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 3 12:56:54 2022] GET /identity/v3/projects => generated 2553 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:56:56.820163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6935-1231-47ae-90a2-6b6a92c70a7d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:56.821034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6935-1231-47ae-90a2-6b6a92c70a7d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:56.821034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6935-1231-47ae-90a2-6b6a92c70a7d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:56.824269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 745/1479] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:56:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:56.830567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd4a2-6e93-4ba2-b683-6e80e2afd2ac None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:56.830994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd4a2-6e93-4ba2-b683-6e80e2afd2ac None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:56.831131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd4a2-6e93-4ba2-b683-6e80e2afd2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:56.850495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0c9cd4a2-6e93-4ba2-b683-6e80e2afd2ac None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:56.851736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0c9cd4a2-6e93-4ba2-b683-6e80e2afd2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:56.861360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 735/1480] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:56.910154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a6935-1231-47ae-90a2-6b6a92c70a7d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:56.933371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a6935-1231-47ae-90a2-6b6a92c70a7d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:56.940428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73ca3c-4fbd-4b8c-a9fa-f34e5b3e33db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:56.941072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73ca3c-4fbd-4b8c-a9fa-f34e5b3e33db service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:56.941355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73ca3c-4fbd-4b8c-a9fa-f34e5b3e33db service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:56.941632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73ca3c-4fbd-4b8c-a9fa-f34e5b3e33db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:56.950162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73ca3c-4fbd-4b8c-a9fa-f34e5b3e33db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:56.952171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73ca3c-4fbd-4b8c-a9fa-f34e5b3e33db service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:56.961626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 746/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:56:59.399370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931b55a-0bd8-4230-95a8-35d6ea0b1558 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:59.400286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931b55a-0bd8-4230-95a8-35d6ea0b1558 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:59.400286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931b55a-0bd8-4230-95a8-35d6ea0b1558 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:59.402673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 736/1482] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:56:59.408276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bceb5-9d13-4eb2-851b-77d2f1e0bca0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:59.408727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bceb5-9d13-4eb2-851b-77d2f1e0bca0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:59.408866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bceb5-9d13-4eb2-851b-77d2f1e0bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:59.431500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a78bceb5-9d13-4eb2-851b-77d2f1e0bca0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:56:59.432717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a78bceb5-9d13-4eb2-851b-77d2f1e0bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:56:59.442233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 747/1483] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:56:59.479591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931b55a-0bd8-4230-95a8-35d6ea0b1558 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:56:59.498482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931b55a-0bd8-4230-95a8-35d6ea0b1558 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:56:59.503142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ef31c-2c29-4b34-b1a2-f6708f239607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:56:59.503793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef31c-2c29-4b34-b1a2-f6708f239607 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:56:59.504079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef31c-2c29-4b34-b1a2-f6708f239607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:56:59.504352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef31c-2c29-4b34-b1a2-f6708f239607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:56:59.514244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ef31c-2c29-4b34-b1a2-f6708f239607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:56:59.515682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ef31c-2c29-4b34-b1a2-f6708f239607 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:56:59.525346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 737/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:57:01.881710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58646-6832-4f0a-be40-a8ba8cd93ce1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:01.882639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58646-6832-4f0a-be40-a8ba8cd93ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:01.882639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58646-6832-4f0a-be40-a8ba8cd93ce1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:01.884728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 748/1485] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:57:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:57:01.891400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb365d-c690-44f9-9de2-2c0b0f6e2e96 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:01.891884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb365d-c690-44f9-9de2-2c0b0f6e2e96 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:01.891984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb365d-c690-44f9-9de2-2c0b0f6e2e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:01.914991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2beb365d-c690-44f9-9de2-2c0b0f6e2e96 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:57:01.916215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2beb365d-c690-44f9-9de2-2c0b0f6e2e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:57:01.925175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 738/1486] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:57:01.963028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a58646-6832-4f0a-be40-a8ba8cd93ce1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:57:01.977316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a58646-6832-4f0a-be40-a8ba8cd93ce1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:57:01.982138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702176e-6db0-4940-8503-bfc1c9e08981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:57:01.982810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702176e-6db0-4940-8503-bfc1c9e08981 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:01.983093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702176e-6db0-4940-8503-bfc1c9e08981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:01.983370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702176e-6db0-4940-8503-bfc1c9e08981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:01.993054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702176e-6db0-4940-8503-bfc1c9e08981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:57:01.994637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702176e-6db0-4940-8503-bfc1c9e08981 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:57:02.004835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 749/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:57:04.437838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d7c97-b773-4385-b853-9ed2825882c4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:04.438555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d7c97-b773-4385-b853-9ed2825882c4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:04.438555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d7c97-b773-4385-b853-9ed2825882c4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:04.440545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 739/1488] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:57:04.448591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24fca-5b6f-4d76-b864-aa094a1dee37 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:04.449100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24fca-5b6f-4d76-b864-aa094a1dee37 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:04.449100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24fca-5b6f-4d76-b864-aa094a1dee37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:04.467481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cdb24fca-5b6f-4d76-b864-aa094a1dee37 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:57:04.468701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cdb24fca-5b6f-4d76-b864-aa094a1dee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:57:04.477157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 750/1489] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:57:04.522426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d7c97-b773-4385-b853-9ed2825882c4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:57:04.541317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d7c97-b773-4385-b853-9ed2825882c4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:57:04.546766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222e546-7058-4839-a82b-f03f1b4c47a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:57:04.547422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e546-7058-4839-a82b-f03f1b4c47a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:04.547706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e546-7058-4839-a82b-f03f1b4c47a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:04.547980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e546-7058-4839-a82b-f03f1b4c47a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:04.559238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222e546-7058-4839-a82b-f03f1b4c47a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:57:04.560685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222e546-7058-4839-a82b-f03f1b4c47a4 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:57:04.571010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 740/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:57:07.092037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bfcdf-0807-429f-8fc9-38e07d1db382 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:07.092646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bfcdf-0807-429f-8fc9-38e07d1db382 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:07.092646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bfcdf-0807-429f-8fc9-38e07d1db382 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:07.093942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 751/1491] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 3 12:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:57:07.099349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d08e7b-d998-4f98-b95a-27ce5724008a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:07.099809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d08e7b-d998-4f98-b95a-27ce5724008a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:07.099916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d08e7b-d998-4f98-b95a-27ce5724008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:07.119927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-03d08e7b-d998-4f98-b95a-27ce5724008a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:57:07.121283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-03d08e7b-d998-4f98-b95a-27ce5724008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:57:07.130495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 741/1492] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 3 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:57:07.169321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bfcdf-0807-429f-8fc9-38e07d1db382 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:57:07.184735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bfcdf-0807-429f-8fc9-38e07d1db382 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:57:07.188794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232b8b2-c83a-43fe-b4ba-7f969b477f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:57:07.189431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232b8b2-c83a-43fe-b4ba-7f969b477f02 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:57:07.189717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232b8b2-c83a-43fe-b4ba-7f969b477f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:57:07.189993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232b8b2-c83a-43fe-b4ba-7f969b477f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:57:07.200055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232b8b2-c83a-43fe-b4ba-7f969b477f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:57:07.201505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232b8b2-c83a-43fe-b4ba-7f969b477f02 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:57:07.211448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 752/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:57:17.113767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=33 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:57:17.206872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=33 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:58:33.335320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2525ec-7d87-46bb-ab5c-a4d47ba456d2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.335967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2525ec-7d87-46bb-ab5c-a4d47ba456d2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.335967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2525ec-7d87-46bb-ab5c-a4d47ba456d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.355992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0a2525ec-7d87-46bb-ab5c-a4d47ba456d2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:58:33.357205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0a2525ec-7d87-46bb-ab5c-a4d47ba456d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:58:33.367064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 742/1494] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:58:33.375405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461f39-740c-4744-af38-1611f1a6de33 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.375920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461f39-740c-4744-af38-1611f1a6de33 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.375920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461f39-740c-4744-af38-1611f1a6de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.394650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c5461f39-740c-4744-af38-1611f1a6de33 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:58:33.395866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c5461f39-740c-4744-af38-1611f1a6de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:58:33.404844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 753/1495] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:58:33.409721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2525ec-7d87-46bb-ab5c-a4d47ba456d2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:33.420263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2525ec-7d87-46bb-ab5c-a4d47ba456d2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:33.426317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:33.426987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.427272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.427551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.428379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:58:33.428692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:33.429723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:33.429723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 12:58:33.429723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 12:58:33.430653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:33.443270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 743/1496] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:58:33.451545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461f39-740c-4744-af38-1611f1a6de33 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:33.461485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461f39-740c-4744-af38-1611f1a6de33 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:33.467465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:33.468122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.468414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.468685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.469384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:33.471198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING py.warnings [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:33.471198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: warnings.warn(msg) Jun 03 12:58:33.471198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: Jun 03 12:58:33.472396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:33.512383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 754/1497] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 12:58:33 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:58:33.516706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:33.526990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3e10-521c-45d9-a8cd-dfd4f82ebcf6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:33.588300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:33.588970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.589252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.589512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.590223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:33.591239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:33.591239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 12:58:33.591239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 12:58:33.592460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:33.622432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 744/1498] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 12:58:33 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:58:33.628086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:33.639095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbf19e-6021-4260-8e4d-251f5865db13 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:33.645217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:33.645887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.646212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.646494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.647230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:33.648260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING py.warnings [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:33.648260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: warnings.warn(msg) Jun 03 12:58:33.648260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: Jun 03 12:58:33.649149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:33.662374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 755/1499] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:58:33.668424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:33.684475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f7dca-1c43-4321-94a0-eaca63c704f1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:33.692570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd78c23-25b8-4877-8fc7-1ed85abc0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:33.693469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd78c23-25b8-4877-8fc7-1ed85abc0046 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.693874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd78c23-25b8-4877-8fc7-1ed85abc0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.694129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd78c23-25b8-4877-8fc7-1ed85abc0046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.694864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd78c23-25b8-4877-8fc7-1ed85abc0046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:33.695897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-ebd78c23-25b8-4877-8fc7-1ed85abc0046 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:33.695897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 12:58:33.695897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 12:58:33.696818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd78c23-25b8-4877-8fc7-1ed85abc0046 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:33.711066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 745/1500] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:58:33.715533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:33.726432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d765a-7258-48dc-93f2-a2299c943ee6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:33.731167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecced9-cb52-4fe5-923e-f8c8aeffd773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:33.732059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecced9-cb52-4fe5-923e-f8c8aeffd773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.732345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecced9-cb52-4fe5-923e-f8c8aeffd773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.732628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecced9-cb52-4fe5-923e-f8c8aeffd773 admin admin] PATH_INFO: `/v3/projects/35afd439733541c9a9002525367bef24/users/26eff17c099d4bb08a49635ee4fa8d81/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.748186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecced9-cb52-4fe5-923e-f8c8aeffd773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35afd439733541c9a9002525367bef24, user_id=26eff17c099d4bb08a49635ee4fa8d81, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:33.749232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING py.warnings [None req-78ecced9-cb52-4fe5-923e-f8c8aeffd773 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:33.749232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: warnings.warn(msg) Jun 03 12:58:33.749232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: Jun 03 12:58:33.751232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecced9-cb52-4fe5-923e-f8c8aeffd773 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:33.773163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 756/1501] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 12:58:33 2022] PUT /identity/v3/projects/35afd439733541c9a9002525367bef24/users/26eff17c099d4bb08a49635ee4fa8d81/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:58:33.792308 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f152e91-6cad-47a5-a314-1bdbc2698b86 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.792848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f152e91-6cad-47a5-a314-1bdbc2698b86 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.793382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f152e91-6cad-47a5-a314-1bdbc2698b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.829637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2f152e91-6cad-47a5-a314-1bdbc2698b86 None None] MFA Rules not processed for user `26eff17c099d4bb08a49635ee4fa8d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:58:33.830914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f152e91-6cad-47a5-a314-1bdbc2698b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:58:33.911875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 746/1502] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:58:33.925872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c70d4d-8343-4c4a-a6b3-625e2fe6688a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.926194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c70d4d-8343-4c4a-a6b3-625e2fe6688a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.926488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c70d4d-8343-4c4a-a6b3-625e2fe6688a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.927899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 757/1503] 10.222.0.58 () {54 vars in 963 bytes} [Fri Jun 3 12:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:58:33.933293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f0a05-b04d-421f-ad9a-46bec47b7466 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:33.933581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f0a05-b04d-421f-ad9a-46bec47b7466 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:33.933856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f0a05-b04d-421f-ad9a-46bec47b7466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:33.953274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2a1f0a05-b04d-421f-ad9a-46bec47b7466 None None] MFA Rules not processed for user `30ea8e8f73ad4862a22ca7ce2b461740`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:58:33.954528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2a1f0a05-b04d-421f-ad9a-46bec47b7466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:58:34.012223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:58:34.021260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 747/1504] 10.222.0.58 () {58 vars in 1060 bytes} [Fri Jun 3 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:58:34.029344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c70d4d-8343-4c4a-a6b3-625e2fe6688a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:34.040796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c70d4d-8343-4c4a-a6b3-625e2fe6688a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:34.044821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:34.045461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:34.045743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:34.046020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:34.055050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:34.056497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:34.065400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 758/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:58:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:58:34.107347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e88cd-7655-44c0-823e-62b97d485263 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:34.107643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e88cd-7655-44c0-823e-62b97d485263 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:34.107930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e88cd-7655-44c0-823e-62b97d485263 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:34.109220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 748/1506] 10.222.0.58 () {52 vars in 829 bytes} [Fri Jun 3 12:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:58:34.113275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:34.179912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1a0ed-e949-4863-ab8e-2907a8a1198d service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:34.186613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:34.187917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:34.188292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:34.188654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] PATH_INFO: `/v3/users/26eff17c099d4bb08a49635ee4fa8d81` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:34.190716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26eff17c099d4bb08a49635ee4fa8d81)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:34.192542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING py.warnings [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:34.192542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: warnings.warn(msg) Jun 03 12:58:34.192542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: Jun 03 12:58:34.194411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:34.286778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26eff17c099d4bb08a49635ee4fa8d81'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:34.299778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26eff17c099d4bb08a49635ee4fa8d81'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:34.312299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26eff17c099d4bb08a49635ee4fa8d81'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:34.329253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:58:34.331866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26eff17c099d4bb08a49635ee4fa8d81'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:34.332847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26eff17c099d4bb08a49635ee4fa8d81'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:34.340232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 759/1507] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 12:58:34 2022] DELETE /identity/v3/users/26eff17c099d4bb08a49635ee4fa8d81 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:58:34.344857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:34.345326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:34.345536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:34.366834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:58:34.368053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:58:34.431427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 749/1508] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:58:34.441825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:34.444441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:58:34.509383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb6b8-4b6f-4b7e-a954-69426e82ff37 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:34.513761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629793d-4373-4d68-87de-5d3ce7102b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:34.514451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629793d-4373-4d68-87de-5d3ce7102b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:34.514736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629793d-4373-4d68-87de-5d3ce7102b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:34.515011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629793d-4373-4d68-87de-5d3ce7102b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:34.524531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629793d-4373-4d68-87de-5d3ce7102b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:34.525982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629793d-4373-4d68-87de-5d3ce7102b39 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:34.535697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 760/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 12:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:58:34.885870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:58:34.887467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:58:34.900657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dce182-80f0-4f0a-819b-57972154e49c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:58:34.909316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:58:34.910486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:58:34.910795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:58:34.911162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] PATH_INFO: `/v3/projects/35afd439733541c9a9002525367bef24` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:58:34.914430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35afd439733541c9a9002525367bef24)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:58:34.915842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:58:34.915842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 12:58:34.915842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 12:58:34.917290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:58:34.981675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35afd439733541c9a9002525367bef24', 'request_id': 'req-1d1016cf-14a3-416e-b53a-8b17be5ee727'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:34.995373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35afd439733541c9a9002525367bef24', 'request_id': 'req-1d1016cf-14a3-416e-b53a-8b17be5ee727'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:35.006358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35afd439733541c9a9002525367bef24', 'request_id': 'req-1d1016cf-14a3-416e-b53a-8b17be5ee727'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:35.018311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] The token cache is being invalidate because project 35afd439733541c9a9002525367bef24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:58:35.018605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:35.019363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d1016cf-14a3-416e-b53a-8b17be5ee727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:58:35.020988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 750/1510] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 12:58:34 2022] DELETE /identity/v3/projects/35afd439733541c9a9002525367bef24 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:58:44.533109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:58:45.014813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:13.867370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2cee-b5c2-4dc6-a429-2450a2330e46 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:13.868295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2cee-b5c2-4dc6-a429-2450a2330e46 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:13.868295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2cee-b5c2-4dc6-a429-2450a2330e46 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:13.870322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:13.875551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef84b9-7959-41a6-bf1d-697f500ba8b5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:13.876004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef84b9-7959-41a6-bf1d-697f500ba8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:13.876116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef84b9-7959-41a6-bf1d-697f500ba8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:13.895115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-aaef84b9-7959-41a6-bf1d-697f500ba8b5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:13.896352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-aaef84b9-7959-41a6-bf1d-697f500ba8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:13.959484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:14.131445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d2cee-b5c2-4dc6-a429-2450a2330e46 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:14.134472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-870d2cee-b5c2-4dc6-a429-2450a2330e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:14.219512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d2cee-b5c2-4dc6-a429-2450a2330e46 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:14.226675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8b636-bf13-4edf-80bf-5e227698f491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:14.227321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b636-bf13-4edf-80bf-5e227698f491 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:14.227602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b636-bf13-4edf-80bf-5e227698f491 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:14.227877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b636-bf13-4edf-80bf-5e227698f491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:14.236557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8b636-bf13-4edf-80bf-5e227698f491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:14.238146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8b636-bf13-4edf-80bf-5e227698f491 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:14.247749 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 762/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:15.124139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738816c-6259-460f-bfd2-78a81ead789b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:15.124767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738816c-6259-460f-bfd2-78a81ead789b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:15.124767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738816c-6259-460f-bfd2-78a81ead789b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:15.127032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:15.132341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5dcd-7323-4a61-a83f-9004769761fc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:15.132797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5dcd-7323-4a61-a83f-9004769761fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:15.132906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5dcd-7323-4a61-a83f-9004769761fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:15.153791 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3bed5dcd-7323-4a61-a83f-9004769761fc None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:15.155023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3bed5dcd-7323-4a61-a83f-9004769761fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:15.164268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:15.331878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738816c-6259-460f-bfd2-78a81ead789b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:15.348670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738816c-6259-460f-bfd2-78a81ead789b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:15.354887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0005c0-437e-4242-b7b4-c6c2e3379f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:15.355527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005c0-437e-4242-b7b4-c6c2e3379f05 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:15.355808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005c0-437e-4242-b7b4-c6c2e3379f05 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:15.356096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005c0-437e-4242-b7b4-c6c2e3379f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:15.365874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0005c0-437e-4242-b7b4-c6c2e3379f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:15.367524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0005c0-437e-4242-b7b4-c6c2e3379f05 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:15.377367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 753/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:15.994417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00bec-b941-44d9-8ffe-d57bec0a581f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:15.994859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00bec-b941-44d9-8ffe-d57bec0a581f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:15.995361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00bec-b941-44d9-8ffe-d57bec0a581f None None] PATH_INFO: `/v3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:15.997474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 764/1517] 10.222.0.59 () {54 vars in 925 bytes} [Fri Jun 3 13:00:15 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:00:16.006002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c31f4-d32c-4395-9409-81055eb90e06 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:16.006348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c31f4-d32c-4395-9409-81055eb90e06 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:16.006627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c31f4-d32c-4395-9409-81055eb90e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:16.026413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9e6c31f4-d32c-4395-9409-81055eb90e06 None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:16.027626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9e6c31f4-d32c-4395-9409-81055eb90e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:16.096822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 754/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jun 3 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:20.225637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad26c-5c6d-4a70-9b3c-3eb7c81b0a18 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:20.226455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad26c-5c6d-4a70-9b3c-3eb7c81b0a18 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:20.226455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad26c-5c6d-4a70-9b3c-3eb7c81b0a18 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:20.227679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 765/1519] 10.222.0.58 () {54 vars in 960 bytes} [Fri Jun 3 13:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:20.234974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b3c3-c38b-4563-915c-5ff4ebef1939 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:20.235919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b3c3-c38b-4563-915c-5ff4ebef1939 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:20.237564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b3c3-c38b-4563-915c-5ff4ebef1939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:20.258538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8578b3c3-c38b-4563-915c-5ff4ebef1939 None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:20.259931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8578b3c3-c38b-4563-915c-5ff4ebef1939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:20.273140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 755/1520] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Jun 3 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:20.281106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ad26c-5c6d-4a70-9b3c-3eb7c81b0a18 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:20.296680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ad26c-5c6d-4a70-9b3c-3eb7c81b0a18 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:20.304085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba3b11-2394-48c9-a930-1f503ab3cbe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:20.304752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba3b11-2394-48c9-a930-1f503ab3cbe2 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:20.305028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba3b11-2394-48c9-a930-1f503ab3cbe2 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:20.305297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba3b11-2394-48c9-a930-1f503ab3cbe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:20.314343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba3b11-2394-48c9-a930-1f503ab3cbe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:20.315926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba3b11-2394-48c9-a930-1f503ab3cbe2 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:20.327407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 766/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:26.678450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254c8d-6036-4bb4-a4fb-46a83b87167d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:26.679009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254c8d-6036-4bb4-a4fb-46a83b87167d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:26.679009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254c8d-6036-4bb4-a4fb-46a83b87167d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:26.680317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:26.686525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d290-e0f5-4764-8d6f-440be70f20c3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:26.687209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d290-e0f5-4764-8d6f-440be70f20c3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:26.687470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d290-e0f5-4764-8d6f-440be70f20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:26.710049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9bb2d290-e0f5-4764-8d6f-440be70f20c3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:26.711285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9bb2d290-e0f5-4764-8d6f-440be70f20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:26.720381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:26.873645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254c8d-6036-4bb4-a4fb-46a83b87167d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:26.889009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254c8d-6036-4bb4-a4fb-46a83b87167d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:26.896677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5ec93-10c0-4893-be53-2191b8499443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:26.897600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ec93-10c0-4893-be53-2191b8499443 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:26.898005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ec93-10c0-4893-be53-2191b8499443 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:26.898637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ec93-10c0-4893-be53-2191b8499443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:26.907802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5ec93-10c0-4893-be53-2191b8499443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:26.909400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5ec93-10c0-4893-be53-2191b8499443 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:26.918929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 757/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:27.781238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1fb7d-5829-4253-9591-1275f1307c44 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:27.782092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1fb7d-5829-4253-9591-1275f1307c44 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:27.782092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1fb7d-5829-4253-9591-1275f1307c44 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:27.784048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:00:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:27.789192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f066d6-34c2-4771-a4b5-ac9499ac97d8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:27.789650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f066d6-34c2-4771-a4b5-ac9499ac97d8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:27.789765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f066d6-34c2-4771-a4b5-ac9499ac97d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:27.809841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d4f066d6-34c2-4771-a4b5-ac9499ac97d8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:27.811089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d4f066d6-34c2-4771-a4b5-ac9499ac97d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:27.819451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:27.970491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1fb7d-5829-4253-9591-1275f1307c44 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:27.989912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1fb7d-5829-4253-9591-1275f1307c44 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:27.996656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf535959-55ea-42d5-9a69-fb130e667b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:27.997333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535959-55ea-42d5-9a69-fb130e667b20 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:27.997614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535959-55ea-42d5-9a69-fb130e667b20 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:27.997887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535959-55ea-42d5-9a69-fb130e667b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:28.007218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf535959-55ea-42d5-9a69-fb130e667b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:28.008925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf535959-55ea-42d5-9a69-fb130e667b20 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:28.019128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 769/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:32.220808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785686f-1f33-4723-b914-dbf81d3faa5b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:32.221822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785686f-1f33-4723-b914-dbf81d3faa5b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:32.221822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785686f-1f33-4723-b914-dbf81d3faa5b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:32.223987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:00:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:32.234014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eef74-0e16-421a-8f5d-ace53216ef2b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:32.234498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eef74-0e16-421a-8f5d-ace53216ef2b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:32.234609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eef74-0e16-421a-8f5d-ace53216ef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:32.257182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f40eef74-0e16-421a-8f5d-ace53216ef2b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:32.258438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f40eef74-0e16-421a-8f5d-ace53216ef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:32.267315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:32.304888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785686f-1f33-4723-b914-dbf81d3faa5b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:32.307809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e785686f-1f33-4723-b914-dbf81d3faa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:32.382037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785686f-1f33-4723-b914-dbf81d3faa5b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:32.386061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f57b2-cf55-4d0a-86be-7ddac5f5a044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:32.386752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f57b2-cf55-4d0a-86be-7ddac5f5a044 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:32.387039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f57b2-cf55-4d0a-86be-7ddac5f5a044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:32.387319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f57b2-cf55-4d0a-86be-7ddac5f5a044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:32.397279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f57b2-cf55-4d0a-86be-7ddac5f5a044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:32.398771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f57b2-cf55-4d0a-86be-7ddac5f5a044 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:32.403937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:32.409174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 760/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:34.622001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917471ed-5f0c-41ff-a917-b4cd78734c33 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:34.622861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917471ed-5f0c-41ff-a917-b4cd78734c33 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:34.623056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917471ed-5f0c-41ff-a917-b4cd78734c33 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:34.625189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:00:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:34.633962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe871-5d64-4fbd-8f38-7a9ee7afce8b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:34.634600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe871-5d64-4fbd-8f38-7a9ee7afce8b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:34.635126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe871-5d64-4fbd-8f38-7a9ee7afce8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:34.659754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b4bfe871-5d64-4fbd-8f38-7a9ee7afce8b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:34.660956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b4bfe871-5d64-4fbd-8f38-7a9ee7afce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:34.669695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:34.708279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917471ed-5f0c-41ff-a917-b4cd78734c33 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:34.715080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=56 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:34.723200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917471ed-5f0c-41ff-a917-b4cd78734c33 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:34.727156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b975d8-09d6-4883-a3d1-df7ec2dc20d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:34.727832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b975d8-09d6-4883-a3d1-df7ec2dc20d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:34.728211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b975d8-09d6-4883-a3d1-df7ec2dc20d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:34.728531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b975d8-09d6-4883-a3d1-df7ec2dc20d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:34.738172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b975d8-09d6-4883-a3d1-df7ec2dc20d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:34.739620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b975d8-09d6-4883-a3d1-df7ec2dc20d7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:34.749352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 772/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:38.521466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1d037-fc39-4665-b344-91bc7603de9e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:38.522220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1d037-fc39-4665-b344-91bc7603de9e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:38.522220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1d037-fc39-4665-b344-91bc7603de9e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:38.524521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:00:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:38.530128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a900e3-92ef-4d09-8c38-b10d00b9eddf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:38.530576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a900e3-92ef-4d09-8c38-b10d00b9eddf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:38.530683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a900e3-92ef-4d09-8c38-b10d00b9eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:38.551421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c1a900e3-92ef-4d09-8c38-b10d00b9eddf None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:38.552658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1a900e3-92ef-4d09-8c38-b10d00b9eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:38.561834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:38.839426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1d037-fc39-4665-b344-91bc7603de9e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:38.842509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7ab1d037-fc39-4665-b344-91bc7603de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:38.914066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1d037-fc39-4665-b344-91bc7603de9e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:38.918502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c922bb9-bb64-44ed-ace9-613c1c938cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:38.919143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c922bb9-bb64-44ed-ace9-613c1c938cfe service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:38.919429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c922bb9-bb64-44ed-ace9-613c1c938cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:38.919694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c922bb9-bb64-44ed-ace9-613c1c938cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:38.929030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c922bb9-bb64-44ed-ace9-613c1c938cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:38.930575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c922bb9-bb64-44ed-ace9-613c1c938cfe service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:38.940975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 763/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:41.195470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7477ef-8079-447d-ad9d-4cb377fba241 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:41.196127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7477ef-8079-447d-ad9d-4cb377fba241 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:41.196127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7477ef-8079-447d-ad9d-4cb377fba241 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:41.197510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:00:41.203088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718703-b9e0-4d1e-8031-d907bcc9da5e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:41.203632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718703-b9e0-4d1e-8031-d907bcc9da5e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:41.203632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718703-b9e0-4d1e-8031-d907bcc9da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:41.230373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-06718703-b9e0-4d1e-8031-d907bcc9da5e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:00:41.231619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-06718703-b9e0-4d1e-8031-d907bcc9da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:41.240713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:00:41.513653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7477ef-8079-447d-ad9d-4cb377fba241 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:00:41.516732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed7477ef-8079-447d-ad9d-4cb377fba241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:00:41.534208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7477ef-8079-447d-ad9d-4cb377fba241 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:00:41.538437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f3155-9a33-4437-b0f2-7691665092a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:00:41.539090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3155-9a33-4437-b0f2-7691665092a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:00:41.539381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3155-9a33-4437-b0f2-7691665092a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:00:41.539664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3155-9a33-4437-b0f2-7691665092a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:00:41.549470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3155-9a33-4437-b0f2-7691665092a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:00:41.550948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3155-9a33-4437-b0f2-7691665092a9 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:00:41.560832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 775/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:00:51.223003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=32 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:51.556642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=14 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:11.105899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159b453-2449-45a0-92ed-46314b0cc97b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.107082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159b453-2449-45a0-92ed-46314b0cc97b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.108149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159b453-2449-45a0-92ed-46314b0cc97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.143358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1159b453-2449-45a0-92ed-46314b0cc97b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.145223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1159b453-2449-45a0-92ed-46314b0cc97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.154607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 765/1540] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:11.163857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe54b-95b8-4308-a226-6b0c1bf206a0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.164415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe54b-95b8-4308-a226-6b0c1bf206a0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.164415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe54b-95b8-4308-a226-6b0c1bf206a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.191242 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-336fe54b-95b8-4308-a226-6b0c1bf206a0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.192481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-336fe54b-95b8-4308-a226-6b0c1bf206a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.203556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 776/1541] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:11.208715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159b453-2449-45a0-92ed-46314b0cc97b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.219899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159b453-2449-45a0-92ed-46314b0cc97b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:11.233804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:11.234970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.235508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.236008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.237291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:11.237831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:11.239721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:11.257827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 766/1542] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:11.266360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fe54b-95b8-4308-a226-6b0c1bf206a0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.280228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fe54b-95b8-4308-a226-6b0c1bf206a0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:11.285380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:11.286054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.286363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.286643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.287340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:11.289258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:11.342452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 777/1543] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:11.347042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.365206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0280f4-9b0c-41b2-af30-ef39c71527d0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:11.449229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:11.449925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.450239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.450520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.451269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:11.453225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:11.495224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 767/1544] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:11.499449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.510645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d9f2f-8c9f-481c-af2e-eb01bac771b0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:11.518836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:11.519536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.519835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.520099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.520848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:11.522609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:11.541563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 778/1545] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:11.543161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.560110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb69586-eef5-4f29-9354-0f855a7ffd63 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:11.569304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2144b67-f812-4382-8136-163949f13290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:11.570713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144b67-f812-4382-8136-163949f13290 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.571294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144b67-f812-4382-8136-163949f13290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.571855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144b67-f812-4382-8136-163949f13290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.572962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2144b67-f812-4382-8136-163949f13290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:11.576167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2144b67-f812-4382-8136-163949f13290 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:11.594816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 768/1546] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:11.599320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.617044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a071-7e78-4575-96db-b6e2c77352fe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:11.628264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af15f0b-cf21-4cdd-8696-91e9c4c5b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:11.629201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af15f0b-cf21-4cdd-8696-91e9c4c5b8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.629488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af15f0b-cf21-4cdd-8696-91e9c4c5b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.629766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af15f0b-cf21-4cdd-8696-91e9c4c5b8be admin admin] PATH_INFO: `/v3/projects/45170704be9845929be13eb3a96eeb07/users/010c4d5ba6b847b79d3127787db2ddd6/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.656233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af15f0b-cf21-4cdd-8696-91e9c4c5b8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=45170704be9845929be13eb3a96eeb07, user_id=010c4d5ba6b847b79d3127787db2ddd6, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:11.659200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af15f0b-cf21-4cdd-8696-91e9c4c5b8be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:11.661060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e4a7-9098-43a4-8a5e-a4d558f643b6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.662261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e4a7-9098-43a4-8a5e-a4d558f643b6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.662791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e4a7-9098-43a4-8a5e-a4d558f643b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.684131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 779/1547] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:11 2022] PUT /identity/v3/projects/45170704be9845929be13eb3a96eeb07/users/010c4d5ba6b847b79d3127787db2ddd6/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:11.689353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fa970-0b31-446c-9bfb-e1850722aa24 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.689653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fa970-0b31-446c-9bfb-e1850722aa24 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.689934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fa970-0b31-446c-9bfb-e1850722aa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.697334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e6c4e4a7-9098-43a4-8a5e-a4d558f643b6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.699133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e6c4e4a7-9098-43a4-8a5e-a4d558f643b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.730290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6d3fa970-0b31-446c-9bfb-e1850722aa24 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.732008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6d3fa970-0b31-446c-9bfb-e1850722aa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.801385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 769/1548] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:11.813826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609170eb-58e3-42e7-a2d5-dd581db9d4f2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.815342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609170eb-58e3-42e7-a2d5-dd581db9d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.815873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609170eb-58e3-42e7-a2d5-dd581db9d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.857069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-609170eb-58e3-42e7-a2d5-dd581db9d4f2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.859066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-609170eb-58e3-42e7-a2d5-dd581db9d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.870360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 780/1549] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:11.879894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 770/1550] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:11.883298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fa970-0b31-446c-9bfb-e1850722aa24 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.884766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609170eb-58e3-42e7-a2d5-dd581db9d4f2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.900396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609170eb-58e3-42e7-a2d5-dd581db9d4f2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:11.919936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ca4e-1b7a-4833-9e99-b25a610de61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:11.921689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ca4e-1b7a-4833-9e99-b25a610de61e admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.922260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ca4e-1b7a-4833-9e99-b25a610de61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.922860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ca4e-1b7a-4833-9e99-b25a610de61e admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.923832 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ca4e-1b7a-4833-9e99-b25a610de61e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:11.924373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ca4e-1b7a-4833-9e99-b25a610de61e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:11.926271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ca4e-1b7a-4833-9e99-b25a610de61e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:11.948079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 771/1551] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:11.950175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c3d1-a199-4314-a2e9-3145f9908774 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.950703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c3d1-a199-4314-a2e9-3145f9908774 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.951225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c3d1-a199-4314-a2e9-3145f9908774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.980988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-53b7c3d1-a199-4314-a2e9-3145f9908774 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.982993 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-53b7c3d1-a199-4314-a2e9-3145f9908774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.997952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fa970-0b31-446c-9bfb-e1850722aa24 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.006042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bec074-d267-4da5-aeed-a249c2b4f743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.006755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bec074-d267-4da5-aeed-a249c2b4f743 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.007067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bec074-d267-4da5-aeed-a249c2b4f743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.007320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bec074-d267-4da5-aeed-a249c2b4f743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.014582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 772/1552] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.015764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c3d1-a199-4314-a2e9-3145f9908774 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.031145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c3d1-a199-4314-a2e9-3145f9908774 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.035023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bec074-d267-4da5-aeed-a249c2b4f743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.036496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bec074-d267-4da5-aeed-a249c2b4f743 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.040035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e99c19-5077-45d7-947b-569e17d07fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.040975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e99c19-5077-45d7-947b-569e17d07fca admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.041496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e99c19-5077-45d7-947b-569e17d07fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.041994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e99c19-5077-45d7-947b-569e17d07fca admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.043036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e99c19-5077-45d7-947b-569e17d07fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.044683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-a5e99c19-5077-45d7-947b-569e17d07fca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:02:12.044683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 13:02:12.044683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 13:02:12.046329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e99c19-5077-45d7-947b-569e17d07fca admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.060763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 781/1553] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:12.062315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f08979-3290-48aa-8770-25070d758226 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.062613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f08979-3290-48aa-8770-25070d758226 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.062906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f08979-3290-48aa-8770-25070d758226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.101543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 773/1554] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.103167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02185c55-65f6-4d85-8bef-dc36e1d4b93a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.103735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02185c55-65f6-4d85-8bef-dc36e1d4b93a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.104124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02185c55-65f6-4d85-8bef-dc36e1d4b93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.108767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d8f08979-3290-48aa-8770-25070d758226 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.110982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d8f08979-3290-48aa-8770-25070d758226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.135144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-02185c55-65f6-4d85-8bef-dc36e1d4b93a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.140200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-02185c55-65f6-4d85-8bef-dc36e1d4b93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.146627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.155048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.188206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 782/1555] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.189450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530fef-7e7f-4c8c-8b69-2d591eb054ef None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.189759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530fef-7e7f-4c8c-8b69-2d591eb054ef None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.190046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530fef-7e7f-4c8c-8b69-2d591eb054ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.212274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c1530fef-7e7f-4c8c-8b69-2d591eb054ef None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.213493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1530fef-7e7f-4c8c-8b69-2d591eb054ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.219235 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 774/1556] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.220521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02185c55-65f6-4d85-8bef-dc36e1d4b93a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.229611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 783/1557] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.237353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020aa09-1ce3-4543-86bf-95ceca02f6eb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.237477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02185c55-65f6-4d85-8bef-dc36e1d4b93a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.237598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020aa09-1ce3-4543-86bf-95ceca02f6eb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.237598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020aa09-1ce3-4543-86bf-95ceca02f6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.243110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f591e8-9d46-442e-bea0-e9563cd6d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.243937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f591e8-9d46-442e-bea0-e9563cd6d09e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.244329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f591e8-9d46-442e-bea0-e9563cd6d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.245169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f591e8-9d46-442e-bea0-e9563cd6d09e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.245978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f591e8-9d46-442e-bea0-e9563cd6d09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.248313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f591e8-9d46-442e-bea0-e9563cd6d09e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.250962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a020aa09-1ce3-4543-86bf-95ceca02f6eb None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.252183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a020aa09-1ce3-4543-86bf-95ceca02f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.263881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 784/1558] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.265200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c537-ec82-465d-abbf-6638f6c7ff6f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.265489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c537-ec82-465d-abbf-6638f6c7ff6f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.265782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c537-ec82-465d-abbf-6638f6c7ff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.281200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 775/1559] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.281200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba48d-edc7-4066-8ce5-291329a9de1c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.281200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba48d-edc7-4066-8ce5-291329a9de1c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.281200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba48d-edc7-4066-8ce5-291329a9de1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.285367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6449c537-ec82-465d-abbf-6638f6c7ff6f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.286902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6449c537-ec82-465d-abbf-6638f6c7ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.298259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 785/1560] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.302163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c537-ec82-465d-abbf-6638f6c7ff6f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.302337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-333ba48d-edc7-4066-8ce5-291329a9de1c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.302971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-333ba48d-edc7-4066-8ce5-291329a9de1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.314259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 776/1561] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.319714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd67fd-bc64-472f-9a7a-cb6726ccfd2f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.320010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd67fd-bc64-472f-9a7a-cb6726ccfd2f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.320394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd67fd-bc64-472f-9a7a-cb6726ccfd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.324674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c537-ec82-465d-abbf-6638f6c7ff6f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.331163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.332020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.332307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.332586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.333445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.333658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.334855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING py.warnings [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:02:12.334855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: warnings.warn(msg) Jun 03 13:02:12.334855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: Jun 03 13:02:12.335816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb057ca2-4179-4fe5-80b2-adf11e9920d1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.342953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c4bd67fd-bc64-472f-9a7a-cb6726ccfd2f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.345260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c4bd67fd-bc64-472f-9a7a-cb6726ccfd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.351509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 786/1562] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.353358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67aee4-fd12-4e3b-8378-48c5730e2c1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.353825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67aee4-fd12-4e3b-8378-48c5730e2c1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.354103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67aee4-fd12-4e3b-8378-48c5730e2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.367594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 777/1563] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.369390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd1c5-7b45-4476-bc90-4223d52609cd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.370542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd1c5-7b45-4476-bc90-4223d52609cd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.370835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd1c5-7b45-4476-bc90-4223d52609cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.384467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5e67aee4-fd12-4e3b-8378-48c5730e2c1c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.385590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5e67aee4-fd12-4e3b-8378-48c5730e2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.392124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-212bd1c5-7b45-4476-bc90-4223d52609cd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.393419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-212bd1c5-7b45-4476-bc90-4223d52609cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.396005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 787/1564] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.400417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67aee4-fd12-4e3b-8378-48c5730e2c1c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.404796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 778/1565] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.404796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacce028-26fb-4799-adfe-d83cd2dda54e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.404796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacce028-26fb-4799-adfe-d83cd2dda54e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.404796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacce028-26fb-4799-adfe-d83cd2dda54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.411320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67aee4-fd12-4e3b-8378-48c5730e2c1c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.416201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394f6df-3e39-4ca5-afe8-223982ff50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.416988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394f6df-3e39-4ca5-afe8-223982ff50ec admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.417372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394f6df-3e39-4ca5-afe8-223982ff50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.417763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394f6df-3e39-4ca5-afe8-223982ff50ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.418635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394f6df-3e39-4ca5-afe8-223982ff50ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.420333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394f6df-3e39-4ca5-afe8-223982ff50ec admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.426602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-aacce028-26fb-4799-adfe-d83cd2dda54e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.427827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-aacce028-26fb-4799-adfe-d83cd2dda54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.431325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 788/1566] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:12.433503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20afc0-dbfe-4c40-9529-96f12d2ca8b2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.433865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20afc0-dbfe-4c40-9529-96f12d2ca8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.434294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20afc0-dbfe-4c40-9529-96f12d2ca8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.440326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 779/1567] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.441357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacce028-26fb-4799-adfe-d83cd2dda54e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.457734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9d20afc0-dbfe-4c40-9529-96f12d2ca8b2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.459019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9d20afc0-dbfe-4c40-9529-96f12d2ca8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.459151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacce028-26fb-4799-adfe-d83cd2dda54e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.472204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 789/1568] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:12.472749 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20afc0-dbfe-4c40-9529-96f12d2ca8b2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.474931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.476638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.476638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.476808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.477653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.479979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.484149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20afc0-dbfe-4c40-9529-96f12d2ca8b2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.489258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.489934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.490323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.490603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.491337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.491641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.493386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.507167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 790/1569] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.511123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.536600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3633-b3e6-4be9-aa5f-aac7cb66db03 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.544308 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 780/1570] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.545262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.622572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.623249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.623529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.623799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.624669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.624974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.627044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.630591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee65c0-d244-4a48-b5bd-6e3730f2097c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.638000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.638757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.639139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.641245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 791/1571] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.641699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.642698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.643125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.643494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.644978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.658294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 781/1572] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.659275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.661012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c8da9-6075-4a9d-a32f-3fe7474f52f0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.670614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.671647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.672109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.672546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.673585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.675462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.676332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c988fb-8d28-447b-ad46-d84d17441cfc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.681466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.682407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.682963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.683464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.684413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.684952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.687089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.687805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 792/1573] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:12.688979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.700450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71710d-dde7-42ed-8df6-ae2afe4cdfd8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.701972 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 782/1574] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.703256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.711286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.712020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.712334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.712553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.713306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.713646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.715346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.715792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45e5d8-37ab-42a0-9d22-c7b87ac51677 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.720693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.721708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.722259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.722760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.724077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.726196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.728186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 793/1575] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.729061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.754799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2251f-14b5-4e15-bebd-73f0fab4440d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.764880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 783/1576] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.765032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.765032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.765251 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.765343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.765343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.765343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.765343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING py.warnings [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:02:12.765343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: warnings.warn(msg) Jun 03 13:02:12.765343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: Jun 03 13:02:12.766313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.770255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.796005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 794/1577] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/users => generated 287 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.796005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.812728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66298a-433d-422c-8ea1-826081a52fe1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.839416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.859073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e537de-d469-4e6f-83b6-f5235d616a96 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.871369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.872111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.872441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.873145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.874062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.876674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.890652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.891687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.892139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.892428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.893131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.895162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.919030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 784/1578] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.924657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.941762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 795/1579] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.947306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.019583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f01b4-4fec-4516-8d6d-dec8c4958462 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.023430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c51c1-3e7f-41b0-a54b-a50e099b9732 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.028438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.029386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.029633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.029911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] PATH_INFO: `/v3/projects/4dd12390001445ba8e59d21bd11b34f4/users/8635705162e04b8fae768d98c5c672c2/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.032615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.033722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.033722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.033946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.034647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.036597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.048146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd12390001445ba8e59d21bd11b34f4, user_id=8635705162e04b8fae768d98c5c672c2, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.049195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:02:13.049195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 13:02:13.049195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 13:02:13.051361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.069979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 785/1580] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:12 2022] PUT /identity/v3/projects/4dd12390001445ba8e59d21bd11b34f4/users/8635705162e04b8fae768d98c5c672c2/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:13.070604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.078576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 796/1581] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:13.080207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.158879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f8da9-8bcc-4935-922e-bd445c873e1d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.163294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc3a4-b273-4ebc-9877-116b4127eb73 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.164887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.165704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.165902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.166209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.167033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.170221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.170397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.172044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.172847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.173332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.174406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.177073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.196428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.206164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 786/1582] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:13.210786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.211135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 797/1583] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:13.212433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.226381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7c439-ed79-442c-9ec5-8af9691f115d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.251630 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.295378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e020d35-3eef-45f1-a330-ce6841f478fa admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.301018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.301886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.302307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.302678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.304201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.305889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.306595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4444c37-4c0c-444b-9e4c-512cff352609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.307479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4444c37-4c0c-444b-9e4c-512cff352609 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.308079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4444c37-4c0c-444b-9e4c-512cff352609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.308555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4444c37-4c0c-444b-9e4c-512cff352609 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.309908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4444c37-4c0c-444b-9e4c-512cff352609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.313786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4444c37-4c0c-444b-9e4c-512cff352609 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.319098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 787/1584] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.320609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.336792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049524a-fbef-4d02-817c-b07655648d82 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.345644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.345861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 798/1585] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:13.345966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.345966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.345966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.346262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0070d3-7761-4968-9b01-e2304d2f97fc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.346262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0070d3-7761-4968-9b01-e2304d2f97fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.346430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.346516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0070d3-7761-4968-9b01-e2304d2f97fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.347602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.367103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-df0070d3-7761-4968-9b01-e2304d2f97fc None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:13.368616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df0070d3-7761-4968-9b01-e2304d2f97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:13.378096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 799/1586] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:13.378825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0070d3-7761-4968-9b01-e2304d2f97fc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.392385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0070d3-7761-4968-9b01-e2304d2f97fc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.392606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 788/1587] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/users => generated 283 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:13.393463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.397033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.397748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.398038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.398346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.399264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.401816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.403973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd9652-0523-418f-a961-63738f24c28e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.409116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.409759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.410043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.410374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.411071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.413342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.428805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 800/1588] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/users => generated 284 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:13.429773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.443502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7c995-320d-4989-aead-dbd982d5527a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.445218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 789/1589] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:13.447124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.449072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.449947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.450240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.450673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.451622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.454894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.461865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a522a-305d-4b74-89ab-22e59d62c442 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.467481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 801/1590] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.468259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.468432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.469352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.469772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.470180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.471303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.473286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.483402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b269f2-5efb-4adf-b869-75f182c49794 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.489537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 790/1591] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.490407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.490695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.491282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.491574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.491900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.492574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.493008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:13.494230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.511326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 802/1592] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.511326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.522241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c4a2-7a78-4305-9d54-ed9492a9e1d9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.528121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.528711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.529034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.529368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.530124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.532199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.543362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 803/1593] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.544427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.556423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b978673-e8c7-4df6-b20d-cd1bb24db78d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.571563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.572307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.572602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.572879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.573726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.575910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.588978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 804/1594] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.589704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcfaf1-860c-4f08-a64a-ec43792666be admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.589837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.595297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.596885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.597520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.597919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.601336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9977f-b6c6-4f3f-9afd-5bf401bf2bcc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.613471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.614047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.614349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.614642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.614922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.615664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.616386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.617297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.633752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 805/1595] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.633752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.635849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 791/1596] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:13.636700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.648010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e1b4-e3ea-4b0e-af7b-84be1b5bf00e service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.654098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.655257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.655699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.656141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] PATH_INFO: `/v3/projects/e6830eb62b8f4150a363d9a60e784af3/users/6b4b886f5ab44740b4764fd64f621a66/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.673638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9505091-9085-4829-bda5-b0116c65be85 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.673880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6830eb62b8f4150a363d9a60e784af3, user_id=6b4b886f5ab44740b4764fd64f621a66, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.676600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.687208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.688999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.688999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.688999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.689319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.690982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.695351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 792/1597] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:13 2022] PUT /identity/v3/projects/e6830eb62b8f4150a363d9a60e784af3/users/6b4b886f5ab44740b4764fd64f621a66/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:13.696345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.721124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 806/1598] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.722022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.737509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6a04-a7ca-40d2-a348-dc8e3524f2d7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.762068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.840751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.842681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.842968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.843523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.844799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.848970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.849745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33ca9a-468d-4c64-8353-cfbbbff2c858 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.869274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.870004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.870338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.870799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.871987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.876169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.885309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 807/1599] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.886507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.910714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ac4b6-8679-4606-a704-8dabbd3c071a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.914471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 793/1600] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.914471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.921406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332fca8-a364-4c88-9f4e-d2a8b9d00352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.923065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332fca8-a364-4c88-9f4e-d2a8b9d00352 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.923453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332fca8-a364-4c88-9f4e-d2a8b9d00352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.923831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332fca8-a364-4c88-9f4e-d2a8b9d00352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.925063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332fca8-a364-4c88-9f4e-d2a8b9d00352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.927166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef89a1e-a361-4afe-bd52-ab0a8c173f7f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.928601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332fca8-a364-4c88-9f4e-d2a8b9d00352 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.933332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.934485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.934961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.935407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.936314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.939323 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.951473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 808/1601] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.956625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 794/1602] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:13.957776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.965276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11eb8-2062-4d97-87a8-1ca6cdd592f9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.965777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11eb8-2062-4d97-87a8-1ca6cdd592f9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.966499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11eb8-2062-4d97-87a8-1ca6cdd592f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.969297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82d948-9ee1-40a3-9c3a-eaa208a1ecbd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.974895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.975867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.976160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.977686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] PATH_INFO: `/v3/projects/8e7d9b1177e144139b715e6cea199b1a/users/2cfcc948ff3742e8a4d6cb288f08b6bc/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.987885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.011171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7d9b1177e144139b715e6cea199b1a, user_id=2cfcc948ff3742e8a4d6cb288f08b6bc, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.011355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-51c11eb8-2062-4d97-87a8-1ca6cdd592f9 None None] MFA Rules not processed for user `6b4b886f5ab44740b4764fd64f621a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:14.014262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-51c11eb8-2062-4d97-87a8-1ca6cdd592f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:14.014581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.050526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 795/1603] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:13 2022] PUT /identity/v3/projects/8e7d9b1177e144139b715e6cea199b1a/users/2cfcc948ff3742e8a4d6cb288f08b6bc/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:14.062615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:14.146298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 809/1604] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:14.146298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c11eb8-2062-4d97-87a8-1ca6cdd592f9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:14.159261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c11eb8-2062-4d97-87a8-1ca6cdd592f9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.160823 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08a8ae-bdea-424f-8655-25cec145e8b0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.169504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.170801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.171161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.171370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] PATH_INFO: `/v3/projects/0c8b3445c26a41708f63d81b13f86483/users/73e5dfadff744e68bfaeff37151c4469/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.173904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.175141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.175843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.176378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] PATH_INFO: `/v3/projects/0678989669d347c7ac86efa6c022f2a5/users/14e7bf0a148f45c38561693404c7dd86/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.190394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8b3445c26a41708f63d81b13f86483, user_id=73e5dfadff744e68bfaeff37151c4469, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.193564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.196819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0678989669d347c7ac86efa6c022f2a5, user_id=14e7bf0a148f45c38561693404c7dd86, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.200826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.221476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 810/1605] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:14 2022] PUT /identity/v3/projects/0c8b3445c26a41708f63d81b13f86483/users/73e5dfadff744e68bfaeff37151c4469/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:14.223387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:14.236621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 796/1606] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:14 2022] PUT /identity/v3/projects/0678989669d347c7ac86efa6c022f2a5/users/14e7bf0a148f45c38561693404c7dd86/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:14.236621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:14.329366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15125f5-0f6b-473a-bc05-0574fadfe610 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.334729 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49313-109e-4c46-9fe0-c3f9e9aba55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.336135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49313-109e-4c46-9fe0-c3f9e9aba55d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.336539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49313-109e-4c46-9fe0-c3f9e9aba55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.337043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49313-109e-4c46-9fe0-c3f9e9aba55d admin admin] PATH_INFO: `/v3/projects/b6cc7be84d074c319f6c2d8628e76f52/users/f2217b3c134d453fbdcb14853eed4e3b/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.348274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661e6d-5f9e-4917-992c-8adaa311aa5b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.360032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49313-109e-4c46-9fe0-c3f9e9aba55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cc7be84d074c319f6c2d8628e76f52, user_id=f2217b3c134d453fbdcb14853eed4e3b, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.361229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.362293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.363278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.363808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] PATH_INFO: `/v3/projects/b7b09c0fea9649f6b72900eae1548fe6/users/2ae61ae780314ecc93bf72f7845486f0/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.365075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49313-109e-4c46-9fe0-c3f9e9aba55d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.368879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.384606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b09c0fea9649f6b72900eae1548fe6, user_id=2ae61ae780314ecc93bf72f7845486f0, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.386413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 797/1607] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:14 2022] PUT /identity/v3/projects/b6cc7be84d074c319f6c2d8628e76f52/users/f2217b3c134d453fbdcb14853eed4e3b/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:14.388094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76208b9e-468f-484e-9866-113bd0184d63 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.388406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76208b9e-468f-484e-9866-113bd0184d63 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.388681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76208b9e-468f-484e-9866-113bd0184d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.393372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.413628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 811/1608] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:14 2022] PUT /identity/v3/projects/b7b09c0fea9649f6b72900eae1548fe6/users/2ae61ae780314ecc93bf72f7845486f0/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:14.414488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:14.432859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-76208b9e-468f-484e-9866-113bd0184d63 None None] MFA Rules not processed for user `2cfcc948ff3742e8a4d6cb288f08b6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:14.434071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-76208b9e-468f-484e-9866-113bd0184d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:14.510129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.527095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ecfa-198a-414c-8ce8-41cb7a7ade62 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.543314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e720ca-c306-4b48-b66e-9b2bb159c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.544112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e720ca-c306-4b48-b66e-9b2bb159c1ea admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.545722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e720ca-c306-4b48-b66e-9b2bb159c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.546545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e720ca-c306-4b48-b66e-9b2bb159c1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.547528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e720ca-c306-4b48-b66e-9b2bb159c1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.550893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e720ca-c306-4b48-b66e-9b2bb159c1ea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.566249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 798/1609] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:14.568074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dfd55-ee52-489d-8b2c-46cbaa0ece4f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.569146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dfd55-ee52-489d-8b2c-46cbaa0ece4f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.569528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dfd55-ee52-489d-8b2c-46cbaa0ece4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.595421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6d8dfd55-ee52-489d-8b2c-46cbaa0ece4f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:14.596878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6d8dfd55-ee52-489d-8b2c-46cbaa0ece4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:14.605243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 812/1610] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:14.605675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 799/1611] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:14.610603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f7d6-b951-4da4-a2c5-69c614465679 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.610773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe774-00c7-4f1b-9dd0-95ec03aecac0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.610886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe774-00c7-4f1b-9dd0-95ec03aecac0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.611155 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f7d6-b951-4da4-a2c5-69c614465679 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.611267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe774-00c7-4f1b-9dd0-95ec03aecac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.611601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f7d6-b951-4da4-a2c5-69c614465679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.645757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5cefe774-00c7-4f1b-9dd0-95ec03aecac0 None None] MFA Rules not processed for user `14e7bf0a148f45c38561693404c7dd86`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:14.646550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b379f7d6-b951-4da4-a2c5-69c614465679 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:14.648028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b379f7d6-b951-4da4-a2c5-69c614465679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:14.648156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5cefe774-00c7-4f1b-9dd0-95ec03aecac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:14.746858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 800/1612] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:14.748777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a33a-043a-408c-a287-9b7bc7627964 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.748777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a33a-043a-408c-a287-9b7bc7627964 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.749002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a33a-043a-408c-a287-9b7bc7627964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.783868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 813/1613] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:14.787610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4474a33a-043a-408c-a287-9b7bc7627964 None None] MFA Rules not processed for user `2ae61ae780314ecc93bf72f7845486f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:14.788237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe774-00c7-4f1b-9dd0-95ec03aecac0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:14.788950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4474a33a-043a-408c-a287-9b7bc7627964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:14.814149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe774-00c7-4f1b-9dd0-95ec03aecac0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.834401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056a436-f316-4027-ae90-82a62d839953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.835108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a436-f316-4027-ae90-82a62d839953 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.835394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a436-f316-4027-ae90-82a62d839953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.835671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a436-f316-4027-ae90-82a62d839953 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.836428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056a436-f316-4027-ae90-82a62d839953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.838426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056a436-f316-4027-ae90-82a62d839953 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.866165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 801/1614] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:14.875171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474a33a-043a-408c-a287-9b7bc7627964 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:14.881459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 814/1615] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:14.885783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a1f3-0f16-4345-be74-1a8418fe6b38 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.886073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a1f3-0f16-4345-be74-1a8418fe6b38 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.888455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a1f3-0f16-4345-be74-1a8418fe6b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.893482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.930856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d6a3a1f3-0f16-4345-be74-1a8418fe6b38 None None] MFA Rules not processed for user `8635705162e04b8fae768d98c5c672c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:14.932083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6a3a1f3-0f16-4345-be74-1a8418fe6b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:14.974553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474a33a-043a-408c-a287-9b7bc7627964 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.981800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b7978-3691-4928-8cbb-7bbbb4c582d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.983545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7978-3691-4928-8cbb-7bbbb4c582d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.984067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7978-3691-4928-8cbb-7bbbb4c582d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.984534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7978-3691-4928-8cbb-7bbbb4c582d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.999542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b7978-3691-4928-8cbb-7bbbb4c582d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.001920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b7978-3691-4928-8cbb-7bbbb4c582d6 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.014638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 802/1616] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:15.015771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a93e3-65eb-467c-8db9-ae476b37d95e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.016410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a93e3-65eb-467c-8db9-ae476b37d95e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.016410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a93e3-65eb-467c-8db9-ae476b37d95e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.018392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 803/1617] 10.222.0.58 () {54 vars in 961 bytes} [Fri Jun 3 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:15.019131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a93e3-65eb-467c-8db9-ae476b37d95e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.035302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 815/1618] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:15.035302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a1f3-0f16-4345-be74-1a8418fe6b38 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.035605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a93e3-65eb-467c-8db9-ae476b37d95e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.036861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.038258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.038742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.039019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.040201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a1f3-0f16-4345-be74-1a8418fe6b38 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.051032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.052712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.053686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.061230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.061520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.061810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.066084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.071222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.078576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 804/1619] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:15.080094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.139405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 816/1620] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:15 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:15.139405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.157776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ab074-7266-414e-8a7a-ddd14cfabc69 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.206044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.272665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03d96b-a87e-4877-afd2-2ae22f618b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.273356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d96b-a87e-4877-afd2-2ae22f618b12 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.273807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d96b-a87e-4877-afd2-2ae22f618b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.274094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d96b-a87e-4877-afd2-2ae22f618b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.309981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c96f8-591c-4819-8646-a9d5e869945d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.328660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58e6a7-0244-41d3-a457-26418313ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.330901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e6a7-0244-41d3-a457-26418313ae62 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.331588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e6a7-0244-41d3-a457-26418313ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.331954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e6a7-0244-41d3-a457-26418313ae62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.333846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58e6a7-0244-41d3-a457-26418313ae62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.338827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58e6a7-0244-41d3-a457-26418313ae62 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.366783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 817/1621] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:15.367785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ac8b-f22f-41c2-bb6b-dc6c1f8d8fa4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.368175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ac8b-f22f-41c2-bb6b-dc6c1f8d8fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.368414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ac8b-f22f-41c2-bb6b-dc6c1f8d8fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.409842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4b92ac8b-f22f-41c2-bb6b-dc6c1f8d8fa4 None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:15.412023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03d96b-a87e-4877-afd2-2ae22f618b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.412443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4b92ac8b-f22f-41c2-bb6b-dc6c1f8d8fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:15.413316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03d96b-a87e-4877-afd2-2ae22f618b12 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.432055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 805/1622] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:15.443203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4748d-44a5-4835-a5a7-30269ad30bdc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.443389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4748d-44a5-4835-a5a7-30269ad30bdc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.443675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4748d-44a5-4835-a5a7-30269ad30bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.471249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.484272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-37b4748d-44a5-4835-a5a7-30269ad30bdc None None] MFA Rules not processed for user `8635705162e04b8fae768d98c5c672c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:15.485620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-37b4748d-44a5-4835-a5a7-30269ad30bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:15.592137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 818/1623] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Jun 3 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:15.594440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ac8b-f22f-41c2-bb6b-dc6c1f8d8fa4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.628145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ac8b-f22f-41c2-bb6b-dc6c1f8d8fa4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.647095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 806/1624] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:15.647317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.647802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.648090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.648378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.649140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.650093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4748d-44a5-4835-a5a7-30269ad30bdc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.651254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.679789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4748d-44a5-4835-a5a7-30269ad30bdc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.712998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 819/1625] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:15 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:15.713947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.718588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeae252-d7a4-4e4e-b45c-8754fc7a79a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.721389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae252-d7a4-4e4e-b45c-8754fc7a79a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.726789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae252-d7a4-4e4e-b45c-8754fc7a79a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.726789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae252-d7a4-4e4e-b45c-8754fc7a79a7 admin admin] PATH_INFO: `/v3/projects/579c97599a3d47049e7dc2f35e2f69f2/users/91bb1c9614f24d3b97be5612c19d307f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.731141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06428-d262-4307-951e-1ecb2d8a2d8d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.740847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.741510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.741794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.742072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.773008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeae252-d7a4-4e4e-b45c-8754fc7a79a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579c97599a3d47049e7dc2f35e2f69f2, user_id=91bb1c9614f24d3b97be5612c19d307f, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.780464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeae252-d7a4-4e4e-b45c-8754fc7a79a7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.813470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 807/1626] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:15 2022] PUT /identity/v3/projects/579c97599a3d47049e7dc2f35e2f69f2/users/91bb1c9614f24d3b97be5612c19d307f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:15.815083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5023a4-3497-438e-bbb7-6c9a4c312e38 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.819512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5023a4-3497-438e-bbb7-6c9a4c312e38 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.820400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5023a4-3497-438e-bbb7-6c9a4c312e38 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.827929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 808/1627] 10.222.0.58 () {54 vars in 961 bytes} [Fri Jun 3 13:02:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:15.830845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5023a4-3497-438e-bbb7-6c9a4c312e38 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.889962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.899658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.949168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 820/1628] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:15.952441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.979550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dcaf9-1104-41fe-b56c-752345d622f1 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.058562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5023a4-3497-438e-bbb7-6c9a4c312e38 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.069061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac66d11-1027-4d30-a0a1-adf61b2f7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.070846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac66d11-1027-4d30-a0a1-adf61b2f7f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.071011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.071416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac66d11-1027-4d30-a0a1-adf61b2f7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.071843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac66d11-1027-4d30-a0a1-adf61b2f7f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.072724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac66d11-1027-4d30-a0a1-adf61b2f7f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.077043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac66d11-1027-4d30-a0a1-adf61b2f7f4b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.102245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 809/1629] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:16.103930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d356b6-3cac-491e-bfb1-125dbe41c775 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.108011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d356b6-3cac-491e-bfb1-125dbe41c775 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.108880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d356b6-3cac-491e-bfb1-125dbe41c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.146601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.146947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.147180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.147468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.148835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.149806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.152492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-08d356b6-3cac-491e-bfb1-125dbe41c775 None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:16.153755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-08d356b6-3cac-491e-bfb1-125dbe41c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:16.179059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 821/1630] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:16.179976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.206351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67672-03c8-4b92-92c5-cd477860fe10 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.221952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.223110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.223523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.223882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] PATH_INFO: `/v3/projects/19b72c98612b423a985d82d7a2448767/users/716cd7f30b8c4942a29d6a4d4ae0db3b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.256150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b72c98612b423a985d82d7a2448767, user_id=716cd7f30b8c4942a29d6a4d4ae0db3b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.260777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.293589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 810/1631] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Jun 3 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:16.296484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d356b6-3cac-491e-bfb1-125dbe41c775 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.318425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 822/1632] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:16 2022] PUT /identity/v3/projects/19b72c98612b423a985d82d7a2448767/users/716cd7f30b8c4942a29d6a4d4ae0db3b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:16.322498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.323662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d356b6-3cac-491e-bfb1-125dbe41c775 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.352745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.489593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.490849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.491613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.491902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] PATH_INFO: `/v3/projects/579c97599a3d47049e7dc2f35e2f69f2/users/91bb1c9614f24d3b97be5612c19d307f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.497900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579c97599a3d47049e7dc2f35e2f69f2, user_id=91bb1c9614f24d3b97be5612c19d307f, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.512626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.528516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1e2c4-465e-4022-93c9-73a6567b30f1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.559649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820c8c2-9bb7-4108-bd86-cea7f79efc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.563834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820c8c2-9bb7-4108-bd86-cea7f79efc06 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.564117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820c8c2-9bb7-4108-bd86-cea7f79efc06 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.564394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820c8c2-9bb7-4108-bd86-cea7f79efc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.575481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 811/1633] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:16 2022] PUT /identity/v3/projects/579c97599a3d47049e7dc2f35e2f69f2/users/91bb1c9614f24d3b97be5612c19d307f/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:16.576940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.676540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820c8c2-9bb7-4108-bd86-cea7f79efc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.679450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820c8c2-9bb7-4108-bd86-cea7f79efc06 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.694010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 823/1634] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:16.695727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea911eb-9720-4dd4-9e65-0416c79b854f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.696215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea911eb-9720-4dd4-9e65-0416c79b854f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.696661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea911eb-9720-4dd4-9e65-0416c79b854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.724891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1ea911eb-9720-4dd4-9e65-0416c79b854f None None] MFA Rules not processed for user `91bb1c9614f24d3b97be5612c19d307f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:16.726511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1ea911eb-9720-4dd4-9e65-0416c79b854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:16.756132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84206309-3e26-416c-8bfd-e533128cc6d9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.756797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.768212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.768945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.769232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.774133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.779324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.783426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.811237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 824/1635] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:16.813036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dbc24-8698-4de3-b045-0f5b591562e6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.813502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dbc24-8698-4de3-b045-0f5b591562e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.813943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dbc24-8698-4de3-b045-0f5b591562e6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.820510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 825/1636] 10.222.0.58 () {54 vars in 912 bytes} [Fri Jun 3 13:02:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:16.822131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186757b-6cab-49a6-b22d-0dd72e10cf05 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.822601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186757b-6cab-49a6-b22d-0dd72e10cf05 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.823046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186757b-6cab-49a6-b22d-0dd72e10cf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.833043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 812/1637] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:16.837436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.844172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e186757b-6cab-49a6-b22d-0dd72e10cf05 None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:16.845930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e186757b-6cab-49a6-b22d-0dd72e10cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:16.933457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 826/1638] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:16.934510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186757b-6cab-49a6-b22d-0dd72e10cf05 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.945598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186757b-6cab-49a6-b22d-0dd72e10cf05 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.950387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.951297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.951595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.951862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] PATH_INFO: `/v3/projects/19b72c98612b423a985d82d7a2448767/users/716cd7f30b8c4942a29d6a4d4ae0db3b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.953971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b72c98612b423a985d82d7a2448767, user_id=716cd7f30b8c4942a29d6a4d4ae0db3b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.956817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.968436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 827/1639] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:16 2022] PUT /identity/v3/projects/19b72c98612b423a985d82d7a2448767/users/716cd7f30b8c4942a29d6a4d4ae0db3b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:16.969327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.033159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043e6bd-4e0d-477a-97c5-c71837c13573 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.036540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22502c-c1e4-4a5b-80ca-719a58703839 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.037690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57119c76-8c83-4e37-b29c-3e4ce04daa44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.038587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57119c76-8c83-4e37-b29c-3e4ce04daa44 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.038977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57119c76-8c83-4e37-b29c-3e4ce04daa44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.039534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57119c76-8c83-4e37-b29c-3e4ce04daa44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.045822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e719d-b24c-47df-80ae-b32907f6763b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.047734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e719d-b24c-47df-80ae-b32907f6763b service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.048030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e719d-b24c-47df-80ae-b32907f6763b service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.049451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e719d-b24c-47df-80ae-b32907f6763b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.118766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.123212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57119c76-8c83-4e37-b29c-3e4ce04daa44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.126015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57119c76-8c83-4e37-b29c-3e4ce04daa44 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.130378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.147017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 813/1640] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:17.169967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1be38-a8f2-4c9e-a8b8-97294f765312 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.172620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1be38-a8f2-4c9e-a8b8-97294f765312 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.173008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1be38-a8f2-4c9e-a8b8-97294f765312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.182967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e719d-b24c-47df-80ae-b32907f6763b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.190907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e719d-b24c-47df-80ae-b32907f6763b service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.231121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 828/1641] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:17.243912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488d27-d025-4247-87fe-20872e710e90 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.244202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488d27-d025-4247-87fe-20872e710e90 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.244481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488d27-d025-4247-87fe-20872e710e90 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.247969 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 829/1642] 10.222.0.58 () {54 vars in 912 bytes} [Fri Jun 3 13:02:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:17.252198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.252558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.252831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.263208 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ccc1be38-a8f2-4c9e-a8b8-97294f765312 None None] MFA Rules not processed for user `716cd7f30b8c4942a29d6a4d4ae0db3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:17.267351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ccc1be38-a8f2-4c9e-a8b8-97294f765312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:17.315757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:17.317152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:17.348299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 830/1643] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:17.373774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.378485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:17.397762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 814/1644] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:17.451976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1be38-a8f2-4c9e-a8b8-97294f765312 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.462643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1be38-a8f2-4c9e-a8b8-97294f765312 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.472921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7e8a6-d1f4-4612-8545-1daf713bd2c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.475497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7e8a6-d1f4-4612-8545-1daf713bd2c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.475791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7e8a6-d1f4-4612-8545-1daf713bd2c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.476106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7e8a6-d1f4-4612-8545-1daf713bd2c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.488751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433097a-b39a-4e32-b9f3-cde5e839ce94 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.492546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021c1c5-3715-4958-bf7b-53d740e571a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.493266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c1c5-3715-4958-bf7b-53d740e571a6 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.493552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c1c5-3715-4958-bf7b-53d740e571a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.493832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c1c5-3715-4958-bf7b-53d740e571a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.498253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7e8a6-d1f4-4612-8545-1daf713bd2c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.501558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7e8a6-d1f4-4612-8545-1daf713bd2c6 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.505878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021c1c5-3715-4958-bf7b-53d740e571a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.507828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021c1c5-3715-4958-bf7b-53d740e571a6 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.523332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 815/1645] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:17.533644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 831/1646] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:18.151234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7cf6-d2ac-47cb-89a4-2da54d403b36 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.151523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7cf6-d2ac-47cb-89a4-2da54d403b36 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.151799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7cf6-d2ac-47cb-89a4-2da54d403b36 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.153186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 816/1647] 10.222.0.58 () {54 vars in 912 bytes} [Fri Jun 3 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:18.159722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ca67-8e7d-447e-b59c-4dfa33556b79 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.160021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ca67-8e7d-447e-b59c-4dfa33556b79 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.160313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ca67-8e7d-447e-b59c-4dfa33556b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.298785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9856ca67-8e7d-447e-b59c-4dfa33556b79 None None] MFA Rules not processed for user `2fa3a98382cd4b04bb384bbc2ab3a598`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:18.300896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9856ca67-8e7d-447e-b59c-4dfa33556b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:18.431862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 832/1648] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:18.450685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f7cf6-d2ac-47cb-89a4-2da54d403b36 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.482058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f7cf6-d2ac-47cb-89a4-2da54d403b36 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.497507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.499920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.500506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.544254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.551393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.553261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.569124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 817/1649] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:18.600712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59d03-7218-4bef-a98c-ded59aecdd39 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.601007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59d03-7218-4bef-a98c-ded59aecdd39 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.601281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59d03-7218-4bef-a98c-ded59aecdd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.627744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.647579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-81a59d03-7218-4bef-a98c-ded59aecdd39 None None] MFA Rules not processed for user `73e5dfadff744e68bfaeff37151c4469`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:18.649474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-81a59d03-7218-4bef-a98c-ded59aecdd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:18.754630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163aadb-9c91-4868-a5b5-eb539529f9a1 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.759820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.761078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.761500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.761907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] PATH_INFO: `/v3/users/6b4b886f5ab44740b4764fd64f621a66` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.770998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4b886f5ab44740b4764fd64f621a66)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.772377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: WARNING py.warnings [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:02:18.772377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: warnings.warn(msg) Jun 03 13:02:18.772377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: Jun 03 13:02:18.774404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.819271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 833/1650] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:18.824133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59d03-7218-4bef-a98c-ded59aecdd39 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.839995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:18.851452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59d03-7218-4bef-a98c-ded59aecdd39 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.856903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.858865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.859163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.859488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.862452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.865630 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.933150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4b886f5ab44740b4764fd64f621a66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:18.936858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 834/1651] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:18 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:18.942003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.965946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4b886f5ab44740b4764fd64f621a66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:18.969873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:18.989802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4b886f5ab44740b4764fd64f621a66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.054235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387a7e-e511-4625-9d3d-4b1b69d94af9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.067972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.069500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.070002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.070481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] PATH_INFO: `/v3/users/14e7bf0a148f45c38561693404c7dd86` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.072023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e7bf0a148f45c38561693404c7dd86)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.074351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.082899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4b886f5ab44740b4764fd64f621a66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.083936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4b886f5ab44740b4764fd64f621a66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.108517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 818/1652] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:18 2022] DELETE /identity/v3/users/6b4b886f5ab44740b4764fd64f621a66 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:19.109521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.117365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.169865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e7bf0a148f45c38561693404c7dd86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.192271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e7bf0a148f45c38561693404c7dd86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.223994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e7bf0a148f45c38561693404c7dd86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.257131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e7bf0a148f45c38561693404c7dd86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.257994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-820bfd99-61ef-43d1-9915-d8fa8db1194a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e7bf0a148f45c38561693404c7dd86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:19.271181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 835/1653] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:18 2022] DELETE /identity/v3/users/14e7bf0a148f45c38561693404c7dd86 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:19.273575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea1b6-43fb-4f5b-b080-755fa0906eb8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.276003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea1b6-43fb-4f5b-b080-755fa0906eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.277372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea1b6-43fb-4f5b-b080-755fa0906eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.315168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cd98-c1b1-4cf4-8cf5-027d15c2f10a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.325867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dc3ea1b6-43fb-4f5b-b080-755fa0906eb8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:19.327503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dc3ea1b6-43fb-4f5b-b080-755fa0906eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.491099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 836/1654] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:19.491099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.491099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.492421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.502215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:19.544498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:19.546645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.560612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 837/1655] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:19.584741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.587190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.588934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.589436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.590769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.593119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.595116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.605062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.693233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 819/1656] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:19 2022] POST /identity/v3/users => generated 308 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:19.696363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.704895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.744674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc1f60-a111-4943-b1c2-19963c635746 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.748685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.749411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.749756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.750181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.762042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.765059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.781080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c09bc-ed5f-4317-83dd-71e778599c26 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.788201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 838/1657] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:19.791082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.795051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.797618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60ff53-d664-44a0-8fa3-7ab96ba02abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.798463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ff53-d664-44a0-8fa3-7ab96ba02abe service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.801784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ff53-d664-44a0-8fa3-7ab96ba02abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.802076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ff53-d664-44a0-8fa3-7ab96ba02abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.824326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ff846-7bfd-465d-b4fe-7b8b5e56353c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.837126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.838125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.838915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.839637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60ff53-d664-44a0-8fa3-7ab96ba02abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.840542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.841291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60ff53-d664-44a0-8fa3-7ab96ba02abe service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.841688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.844998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.872069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 839/1658] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:19.873209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.881622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 820/1659] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:19.886936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f554-c361-4fbb-a4e8-fc59e3a4ca26 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.887262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f554-c361-4fbb-a4e8-fc59e3a4ca26 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.887547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f554-c361-4fbb-a4e8-fc59e3a4ca26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.902963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879182-f2a6-459c-b921-35de0c943e96 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.915059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.915978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.916446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.916558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] PATH_INFO: `/v3/projects/09d29b2488064263b1b950566d11c885/users/2328cde208af4f29b1b0fc8dba52c5c1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.952292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d29b2488064263b1b950566d11c885, user_id=2328cde208af4f29b1b0fc8dba52c5c1, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.959899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.992343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-35d6f554-c361-4fbb-a4e8-fc59e3a4ca26 None None] MFA Rules not processed for user `010c4d5ba6b847b79d3127787db2ddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:19.998180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 840/1660] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:19 2022] PUT /identity/v3/projects/09d29b2488064263b1b950566d11c885/users/2328cde208af4f29b1b0fc8dba52c5c1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:19.999277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-35d6f554-c361-4fbb-a4e8-fc59e3a4ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:20.002334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.170269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:20.179832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac13b-2fe7-4e34-bf80-47929de37681 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.191260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67047ebd-55f9-443d-8043-ddc98a10227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.191965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047ebd-55f9-443d-8043-ddc98a10227b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.192251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047ebd-55f9-443d-8043-ddc98a10227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.192540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047ebd-55f9-443d-8043-ddc98a10227b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.193273 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67047ebd-55f9-443d-8043-ddc98a10227b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.195030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67047ebd-55f9-443d-8043-ddc98a10227b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.219152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 821/1662] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:20.219338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 841/1662] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:20.220899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dad24-4b7c-4bca-a22e-534c5db4b3c4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.226648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b3c4-070e-42ea-8cb7-c84bffd5fa32 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.227168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dad24-4b7c-4bca-a22e-534c5db4b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.227551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b3c4-070e-42ea-8cb7-c84bffd5fa32 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.227922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dad24-4b7c-4bca-a22e-534c5db4b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.228249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b3c4-070e-42ea-8cb7-c84bffd5fa32 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.231977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 822/1663] 10.222.0.58 () {54 vars in 960 bytes} [Fri Jun 3 13:02:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:20.233689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b3c4-070e-42ea-8cb7-c84bffd5fa32 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.253856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-877dad24-4b7c-4bca-a22e-534c5db4b3c4 None None] MFA Rules not processed for user `010c4d5ba6b847b79d3127787db2ddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:20.255433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-877dad24-4b7c-4bca-a22e-534c5db4b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:20.264253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 842/1664] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:20.265663 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859169-7fae-4466-b46e-9cd8975b6d08 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.266157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859169-7fae-4466-b46e-9cd8975b6d08 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.266493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859169-7fae-4466-b46e-9cd8975b6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.289070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b3c4-070e-42ea-8cb7-c84bffd5fa32 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.293447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ce859169-7fae-4466-b46e-9cd8975b6d08 None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:20.294917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce859169-7fae-4466-b46e-9cd8975b6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:20.299576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.300692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.301108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.301506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] PATH_INFO: `/v3/projects/09d29b2488064263b1b950566d11c885/users/2328cde208af4f29b1b0fc8dba52c5c1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.315152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d29b2488064263b1b950566d11c885, user_id=2328cde208af4f29b1b0fc8dba52c5c1, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.318330 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.335362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 823/1665] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:20 2022] PUT /identity/v3/projects/09d29b2488064263b1b950566d11c885/users/2328cde208af4f29b1b0fc8dba52c5c1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:20.339599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.341737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:20.356914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:20.382293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 843/1666] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Jun 3 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:20.389965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859169-7fae-4466-b46e-9cd8975b6d08 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.410239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859169-7fae-4466-b46e-9cd8975b6d08 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.496879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9aaf7-d560-4aa4-a0b2-1414d2bec9f6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.504548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.505691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.506215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.506769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.598035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.598663 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.598955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.599241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.602833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:20.609337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.611202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.636762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.638864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.647448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 824/1667] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:20.673954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 844/1668] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:20.973503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.975096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:21.073378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.075241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:21.156418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393cf0-b994-4e41-9808-a6b675410809 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:21.176131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:21.177041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.177341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.177600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] PATH_INFO: `/v3/projects/e6830eb62b8f4150a363d9a60e784af3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.181547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6830eb62b8f4150a363d9a60e784af3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:21.183584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:21.222550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:21.237410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90bc4-e370-44f9-87ba-f28a2a473272 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:21.254160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:21.255193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.257339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.258372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] PATH_INFO: `/v3/projects/0678989669d347c7ac86efa6c022f2a5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.261079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0678989669d347c7ac86efa6c022f2a5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:21.265270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: WARNING py.warnings [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:02:21.265270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: warnings.warn(msg) Jun 03 13:02:21.265270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: Jun 03 13:02:21.267386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:21.308788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6830eb62b8f4150a363d9a60e784af3', 'request_id': 'req-fb4a8257-7f41-4419-ba83-19e767140029'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.324717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6830eb62b8f4150a363d9a60e784af3', 'request_id': 'req-fb4a8257-7f41-4419-ba83-19e767140029'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.343778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6830eb62b8f4150a363d9a60e784af3', 'request_id': 'req-fb4a8257-7f41-4419-ba83-19e767140029'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.370074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] The token cache is being invalidate because project e6830eb62b8f4150a363d9a60e784af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:21.372570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.375180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.379786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 825/1669] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:20 2022] DELETE /identity/v3/projects/e6830eb62b8f4150a363d9a60e784af3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:21.380942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.387170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:21.409865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0678989669d347c7ac86efa6c022f2a5', 'request_id': 'req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.446029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0678989669d347c7ac86efa6c022f2a5', 'request_id': 'req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.475912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0678989669d347c7ac86efa6c022f2a5', 'request_id': 'req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.501840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] The token cache is being invalidate because project 0678989669d347c7ac86efa6c022f2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:21.502158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.504402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.507566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 845/1670] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:21 2022] DELETE /identity/v3/projects/0678989669d347c7ac86efa6c022f2a5 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:21.508612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.510992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:21.541973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:21.576530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8257-7f41-4419-ba83-19e767140029 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:21.720035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:21.720957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.721244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.721522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] PATH_INFO: `/v3/users/2cfcc948ff3742e8a4d6cb288f08b6bc` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.730013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfcc948ff3742e8a4d6cb288f08b6bc)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:21.733907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:21.734992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed7d95-8fef-49c7-bca6-ec3c4cbe9e60 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:21.750411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:21.753148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.753631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.754062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] PATH_INFO: `/v3/users/91bb1c9614f24d3b97be5612c19d307f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.756093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91bb1c9614f24d3b97be5612c19d307f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:21.758701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:21.896404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91bb1c9614f24d3b97be5612c19d307f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.911748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfcc948ff3742e8a4d6cb288f08b6bc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.914974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91bb1c9614f24d3b97be5612c19d307f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.918910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:21.930953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfcc948ff3742e8a4d6cb288f08b6bc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.937354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91bb1c9614f24d3b97be5612c19d307f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.957944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfcc948ff3742e8a4d6cb288f08b6bc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.970561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91bb1c9614f24d3b97be5612c19d307f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.973167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91bb1c9614f24d3b97be5612c19d307f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.989944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 846/1671] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:21 2022] DELETE /identity/v3/users/91bb1c9614f24d3b97be5612c19d307f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:21.990961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.991924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfcc948ff3742e8a4d6cb288f08b6bc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.993131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-341dfadb-7345-4d87-ba2c-cad684144fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfcc948ff3742e8a4d6cb288f08b6bc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:21.996696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:22.006103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 826/1672] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:21 2022] DELETE /identity/v3/users/2cfcc948ff3742e8a4d6cb288f08b6bc => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:22.013256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260a930-7ea6-486f-b79a-62e4a210b114 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.013616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260a930-7ea6-486f-b79a-62e4a210b114 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.013829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260a930-7ea6-486f-b79a-62e4a210b114 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.026435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 827/1673] 10.222.0.58 () {54 vars in 912 bytes} [Fri Jun 3 13:02:22 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:22.028181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc28ed-4e34-4e96-8124-233cd7e2300e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.028513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc28ed-4e34-4e96-8124-233cd7e2300e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.028843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc28ed-4e34-4e96-8124-233cd7e2300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.071945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9fcc28ed-4e34-4e96-8124-233cd7e2300e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:22.080137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9fcc28ed-4e34-4e96-8124-233cd7e2300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:22.162765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de0aab-a206-4df2-b53a-615f76ec7fe2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:22.214597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:22.239315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 828/1674] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:22.241058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.242916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.244047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.260509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:22.261664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.262091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.262564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] PATH_INFO: `/v3/users/716cd7f30b8c4942a29d6a4d4ae0db3b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.264097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716cd7f30b8c4942a29d6a4d4ae0db3b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:22.266582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:22.276524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] MFA Rules not processed for user `2fa3a98382cd4b04bb384bbc2ab3a598`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:22.278811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:22.363074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 829/1675] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:22.364196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:22.366493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:22.376371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716cd7f30b8c4942a29d6a4d4ae0db3b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:22.386282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005dabc-29b7-47b4-ba33-99a36ee63fde None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:22.387183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716cd7f30b8c4942a29d6a4d4ae0db3b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:22.394461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:22.394461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.394461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.394461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.403561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716cd7f30b8c4942a29d6a4d4ae0db3b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:22.408200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:22.409909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:22.424989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 830/1676] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:22.425875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:22.426008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716cd7f30b8c4942a29d6a4d4ae0db3b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:22.427969 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716cd7f30b8c4942a29d6a4d4ae0db3b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:22.437409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 847/1677] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:21 2022] DELETE /identity/v3/users/716cd7f30b8c4942a29d6a4d4ae0db3b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:22.438946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea162-91a1-4d63-a580-a9f629eb1ec7 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:22.515078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9427cc-a3ba-4e50-8693-d2ef2f336cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:22.515643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9427cc-a3ba-4e50-8693-d2ef2f336cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.516080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9427cc-a3ba-4e50-8693-d2ef2f336cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.516435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9427cc-a3ba-4e50-8693-d2ef2f336cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.528311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bc9427cc-a3ba-4e50-8693-d2ef2f336cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:22.548230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9427cc-a3ba-4e50-8693-d2ef2f336cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:22.549694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9427cc-a3ba-4e50-8693-d2ef2f336cf6 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:22.562342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 831/1678] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:22.823671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:22.825718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:23.024577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6537-1ac9-426d-b9ad-f5b18a24aee5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.051519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.053095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.053569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.053988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] PATH_INFO: `/v3/projects/579c97599a3d47049e7dc2f35e2f69f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.057820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=579c97599a3d47049e7dc2f35e2f69f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:23.060791 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:23.162642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579c97599a3d47049e7dc2f35e2f69f2', 'request_id': 'req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:23.172886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579c97599a3d47049e7dc2f35e2f69f2', 'request_id': 'req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:23.195335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.203420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579c97599a3d47049e7dc2f35e2f69f2', 'request_id': 'req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:23.265727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] The token cache is being invalidate because project 579c97599a3d47049e7dc2f35e2f69f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:23.270805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:23.272574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76c69d5c-eaba-47e7-9bfb-f9b811dcc6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:23.280720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 848/1679] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:22 2022] DELETE /identity/v3/projects/579c97599a3d47049e7dc2f35e2f69f2 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:23.283015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606645c-9f93-49fa-ad1b-b614a4182521 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.283747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606645c-9f93-49fa-ad1b-b614a4182521 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.284055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606645c-9f93-49fa-ad1b-b614a4182521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.318059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.337408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f606645c-9f93-49fa-ad1b-b614a4182521 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:23.342229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f606645c-9f93-49fa-ad1b-b614a4182521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:23.532441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 832/1680] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:23.536348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0f16-f28e-4b30-9c96-7b251177325e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.536348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0f16-f28e-4b30-9c96-7b251177325e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.536348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0f16-f28e-4b30-9c96-7b251177325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.566376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-24dd0f16-f28e-4b30-9c96-7b251177325e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:23.580429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-24dd0f16-f28e-4b30-9c96-7b251177325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:23.617461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 849/1681] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:23.622010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606645c-9f93-49fa-ad1b-b614a4182521 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.632182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606645c-9f93-49fa-ad1b-b614a4182521 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.649047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.649828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.650150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.650503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.651283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:23.651594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:23.653309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:23.686214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd0f16-f28e-4b30-9c96-7b251177325e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.696544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd0f16-f28e-4b30-9c96-7b251177325e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.697581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 833/1682] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:23.715516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43275d1-5541-4e49-9c76-f4596a10a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.716239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43275d1-5541-4e49-9c76-f4596a10a03a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.716519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43275d1-5541-4e49-9c76-f4596a10a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.716841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43275d1-5541-4e49-9c76-f4596a10a03a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.717548 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43275d1-5541-4e49-9c76-f4596a10a03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:23.722280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43275d1-5541-4e49-9c76-f4596a10a03a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:23.799719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 850/1683] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:23.818142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.894583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c279b-53f5-4f6f-973c-4000f21b6b40 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.903126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8304865-056d-4ab6-8af8-57be98781033 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.903529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8304865-056d-4ab6-8af8-57be98781033 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.903689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8304865-056d-4ab6-8af8-57be98781033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.947440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c8304865-056d-4ab6-8af8-57be98781033 None None] MFA Rules not processed for user `010c4d5ba6b847b79d3127787db2ddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:23.949111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8304865-056d-4ab6-8af8-57be98781033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:24.091990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 851/1684] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:24.115423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.125676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.125968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.126275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.126998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.128985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.134625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266710ac-61a9-4a6f-aac1-56c4a44b54d7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.135287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266710ac-61a9-4a6f-aac1-56c4a44b54d7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.135713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266710ac-61a9-4a6f-aac1-56c4a44b54d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.191384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-266710ac-61a9-4a6f-aac1-56c4a44b54d7 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:24.192991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-266710ac-61a9-4a6f-aac1-56c4a44b54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:24.202991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 834/1685] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/users => generated 285 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:24.207159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.225466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b84c7-83b2-4115-a71f-fbb6a33946c1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.248418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.249123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.249414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.249692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.250586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.252254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.288172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 835/1686] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:02:24.302130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.326916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cd03e-e268-40a7-bbc7-66c805a1feb6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.348719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.349337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.349624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.349903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.350672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.352287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.363629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 852/1687] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:24.393549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 836/1688] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:02:24.410812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266710ac-61a9-4a6f-aac1-56c4a44b54d7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.422339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.427581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:24.450265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549214-a207-4cc1-96ca-3e5fc798892b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.463186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.463582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266710ac-61a9-4a6f-aac1-56c4a44b54d7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.471007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd43d3-a384-4d8a-8662-948ce75b36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.471929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd43d3-a384-4d8a-8662-948ce75b36fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.472448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd43d3-a384-4d8a-8662-948ce75b36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.473200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd43d3-a384-4d8a-8662-948ce75b36fa admin admin] PATH_INFO: `/v3/projects/a732df7a48b44ca3b0b47cdc196c29b2/users/5061eb599046423795eb571ebd2b99b1/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.483451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.483985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.485298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] PATH_INFO: `/v3/projects/19b72c98612b423a985d82d7a2448767` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.495000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd43d3-a384-4d8a-8662-948ce75b36fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a732df7a48b44ca3b0b47cdc196c29b2, user_id=5061eb599046423795eb571ebd2b99b1, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.496822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b72c98612b423a985d82d7a2448767)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.499258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd43d3-a384-4d8a-8662-948ce75b36fa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.504882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.533002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 853/1689] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:24 2022] PUT /identity/v3/projects/a732df7a48b44ca3b0b47cdc196c29b2/users/5061eb599046423795eb571ebd2b99b1/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:24.546957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e6be-d2fa-42d3-a740-fff434faed56 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.547563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e6be-d2fa-42d3-a740-fff434faed56 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.548238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e6be-d2fa-42d3-a740-fff434faed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.634463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0bd6e6be-d2fa-42d3-a740-fff434faed56 None None] MFA Rules not processed for user `5061eb599046423795eb571ebd2b99b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:24.635802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0bd6e6be-d2fa-42d3-a740-fff434faed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:24.681937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b72c98612b423a985d82d7a2448767', 'request_id': 'req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:24.702685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b72c98612b423a985d82d7a2448767', 'request_id': 'req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:24.712682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:24.728711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b72c98612b423a985d82d7a2448767', 'request_id': 'req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:24.775954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] The token cache is being invalidate because project 19b72c98612b423a985d82d7a2448767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:24.776258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:24.778505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:24.788042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 837/1690] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:24 2022] DELETE /identity/v3/projects/19b72c98612b423a985d82d7a2448767 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:24.788042 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.789984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:24.790728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:24.916043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 854/1691] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:24.917213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.917506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.917785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.963382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:24.966323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:25.032969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8ffb-1b56-48a9-9231-2f86c9c0949d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.056443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.057134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.057416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.059921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.069692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:25.112789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 855/1692] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:25.114210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:25.120632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:25.147040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3479072-43bf-4e48-864f-bdd1c64afed5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.163128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.164037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.164323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.167010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] PATH_INFO: `/v3/projects/8e7d9b1177e144139b715e6cea199b1a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.169479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7d9b1177e144139b715e6cea199b1a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.174904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.293661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.298941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.307609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7d9b1177e144139b715e6cea199b1a', 'request_id': 'req-7a37d665-0727-4e73-9d9a-872fd486e120'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:25.322604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 838/1693] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:02:25.324589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:25.324837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7d9b1177e144139b715e6cea199b1a', 'request_id': 'req-7a37d665-0727-4e73-9d9a-872fd486e120'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:25.329588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:25.343895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7d9b1177e144139b715e6cea199b1a', 'request_id': 'req-7a37d665-0727-4e73-9d9a-872fd486e120'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:25.376423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] The token cache is being invalidate because project 8e7d9b1177e144139b715e6cea199b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:25.376707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:25.379916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66239c-1460-4f4b-ab5a-7d77bf37086e service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.382138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a37d665-0727-4e73-9d9a-872fd486e120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:25.395671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 856/1694] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:25 2022] DELETE /identity/v3/projects/8e7d9b1177e144139b715e6cea199b1a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:25.397315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e347-a6f4-4d86-8943-95b0943b8a55 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.397613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e347-a6f4-4d86-8943-95b0943b8a55 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.397896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e347-a6f4-4d86-8943-95b0943b8a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.485484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3610e347-a6f4-4d86-8943-95b0943b8a55 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:25.489506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3610e347-a6f4-4d86-8943-95b0943b8a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:25.598801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:25.620738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 857/1695] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:25.620738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428043-ec65-4070-a7ba-59d2f671a32a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.620738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428043-ec65-4070-a7ba-59d2f671a32a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.620738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428043-ec65-4070-a7ba-59d2f671a32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.646970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce22d8-1b77-412c-b4ee-bfb9aeb1d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.650872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce22d8-1b77-412c-b4ee-bfb9aeb1d21c admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.651282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce22d8-1b77-412c-b4ee-bfb9aeb1d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.651704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce22d8-1b77-412c-b4ee-bfb9aeb1d21c admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.653034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce22d8-1b77-412c-b4ee-bfb9aeb1d21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.655903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce22d8-1b77-412c-b4ee-bfb9aeb1d21c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.719499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-91428043-ec65-4070-a7ba-59d2f671a32a None None] MFA Rules not processed for user `2328cde208af4f29b1b0fc8dba52c5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:25.721776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91428043-ec65-4070-a7ba-59d2f671a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:25.733592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 839/1696] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:25 2022] POST /identity/v3/projects => generated 369 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:25.735701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.736576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.737060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.789818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:25.792166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:25.806096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:25.973766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 858/1697] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:25.974811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428043-ec65-4070-a7ba-59d2f671a32a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.005108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428043-ec65-4070-a7ba-59d2f671a32a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.037472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 840/1698] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:26.044600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.048966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:26.112489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06bf6-04c8-464f-b005-48f5fd953bf9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.136621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11382b64-685b-4e16-a5b8-00ed3d23cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.137392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11382b64-685b-4e16-a5b8-00ed3d23cca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.137677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11382b64-685b-4e16-a5b8-00ed3d23cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.137956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11382b64-685b-4e16-a5b8-00ed3d23cca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.138753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11382b64-685b-4e16-a5b8-00ed3d23cca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.150724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11382b64-685b-4e16-a5b8-00ed3d23cca2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.210426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.217426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.220436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.220927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.225452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:26.228675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.235366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.249903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 841/1699] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:26.260517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8712e-25a7-47cc-9a9b-b50c832db105 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.262657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8712e-25a7-47cc-9a9b-b50c832db105 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.263053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8712e-25a7-47cc-9a9b-b50c832db105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.302152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 859/1700] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:26.302152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.324229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c554-a32e-4db4-ac05-875bc6b2a47d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.326681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7da8712e-25a7-47cc-9a9b-b50c832db105 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:26.330732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7da8712e-25a7-47cc-9a9b-b50c832db105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:26.340426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.341122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.341415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.341706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.342696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.346321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.375828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 842/1701] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:26.377432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8712e-25a7-47cc-9a9b-b50c832db105 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.384393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 860/1702] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:26.384393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.405960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8712e-25a7-47cc-9a9b-b50c832db105 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.420401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54153c19-15ab-4128-ae16-a6572470a857 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.421081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.423869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.426310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.426826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.429543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.432266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.454325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.455319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.455608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.457169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.459381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:26.459708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.461378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.516694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 861/1703] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:26.517977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.549428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158eda0-c182-4fb0-90ec-3ae9af79202e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.562046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 843/1704] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:26.563445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.588589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.588589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.588589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.588589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] PATH_INFO: `/v3/projects/5b3efca5f8ad404f814ab9c5b12ebcd2/users/d403474951f9465090e2d0a675f22846/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.626638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3efca5f8ad404f814ab9c5b12ebcd2, user_id=d403474951f9465090e2d0a675f22846, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.639040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.684484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 862/1705] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:26 2022] PUT /identity/v3/projects/5b3efca5f8ad404f814ab9c5b12ebcd2/users/d403474951f9465090e2d0a675f22846/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:26.684484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.796731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:26.838779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6ed68-f803-4401-959d-24473e5b37f3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.865136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b9f74-af97-4f29-9aa0-d5692cfc8daf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.872672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.878580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.879116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.879554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.880607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.883456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.915167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 863/1706] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:26.916123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.938406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedbc3-e4de-4cd1-bf9c-09ded0647529 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.947019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.947019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.958758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.960355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.961178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.966134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.020605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 864/1707] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:27.022531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.044083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344e7b-8222-4ec5-ba8d-539fa46bbbd1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.056351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.056351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.056351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.056351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.056838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.056838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.058913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.059964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.059964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.060162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.060845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.063030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.095297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 865/1708] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:27.098268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.135618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:27.149164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 844/1709] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/projects => generated 387 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:27.150783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b04e-853b-40a4-b07d-3601232737c9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.151295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.388770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.390554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.392538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.394031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] PATH_INFO: `/v3/projects/5b3efca5f8ad404f814ab9c5b12ebcd2/users/d403474951f9465090e2d0a675f22846/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.397780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3efca5f8ad404f814ab9c5b12ebcd2, user_id=d403474951f9465090e2d0a675f22846, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.407691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.452662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ed80-6e0c-4960-9d3f-8a7294ef2b89 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.469615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 866/1710] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:27 2022] PUT /identity/v3/projects/5b3efca5f8ad404f814ab9c5b12ebcd2/users/d403474951f9465090e2d0a675f22846/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:27.481789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.719914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef4b53-dca9-43ef-85b4-7247550d586b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.733726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81749b-8eec-459c-8529-e75a3bd8828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.734589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81749b-8eec-459c-8529-e75a3bd8828a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.734927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81749b-8eec-459c-8529-e75a3bd8828a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.735268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81749b-8eec-459c-8529-e75a3bd8828a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.736161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81749b-8eec-459c-8529-e75a3bd8828a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.750989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.755642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.757567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81749b-8eec-459c-8529-e75a3bd8828a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.758212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.758626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.768847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.771222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.807204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 845/1711] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 657 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:27.809715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081a39-5e54-4808-b7ee-41a39979922c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.810046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081a39-5e54-4808-b7ee-41a39979922c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.810374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081a39-5e54-4808-b7ee-41a39979922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.834699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 867/1712] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:27 2022] POST /identity/v3/users => generated 294 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:27.846408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.887314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d0131-8642-40db-8335-4d75c8893935 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.896469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.900656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.903116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.904503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5f081a39-5e54-4808-b7ee-41a39979922c None None] MFA Rules not processed for user `d403474951f9465090e2d0a675f22846`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:27.905081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] PATH_INFO: `/v3/projects/3571df9f9c654b6ba76d5abba5b66137/users/59ee22a7276545deacb8456345a2d81e/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.905940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5f081a39-5e54-4808-b7ee-41a39979922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:27.964467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3571df9f9c654b6ba76d5abba5b66137, user_id=59ee22a7276545deacb8456345a2d81e, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.982867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.986473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:28.039453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 868/1713] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:27 2022] PUT /identity/v3/projects/3571df9f9c654b6ba76d5abba5b66137/users/59ee22a7276545deacb8456345a2d81e/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:28.039453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:28.188539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 846/1714] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:28.195134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8058b4-5b6d-4d73-8cb6-9ff6cfb11d6d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:28.195311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8058b4-5b6d-4d73-8cb6-9ff6cfb11d6d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:28.195539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8058b4-5b6d-4d73-8cb6-9ff6cfb11d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:28.268170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3e8058b4-5b6d-4d73-8cb6-9ff6cfb11d6d None None] MFA Rules not processed for user `59ee22a7276545deacb8456345a2d81e`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:28.269487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3e8058b4-5b6d-4d73-8cb6-9ff6cfb11d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:28.277414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb4fde-7564-4262-bda8-e0d51e7cabfb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:28.294436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:28.296481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:28.297117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:28.298245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:28.299981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:28.311346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:28.334143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:28.373089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 869/1715] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:28.374557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:28.376627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:28.517922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42807ec-e1f7-43cd-8025-695c8bcd8768 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:28.557630 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:28.562285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:28.562733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:28.563669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:28.618825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 847/1716] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:28.618825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8058b4-5b6d-4d73-8cb6-9ff6cfb11d6d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:28.644627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8058b4-5b6d-4d73-8cb6-9ff6cfb11d6d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:28.671515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:28.673213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:28.673512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:28.673795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:28.681665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:28.683555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:28.731905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 848/1717] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:28.733427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:28.753197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bb83e-2839-4e8a-8cf4-f22ed4d13d57 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:28.774694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:28.775394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:28.775678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:28.775956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:28.776670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:28.794564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:28.836474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:28.838259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:28.863500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 849/1718] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:28 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:28.870032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 870/1719] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:28.875581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:28.877373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:28.937403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27168-f371-4342-aa70-700bf1783add service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:29.023435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b403f-d68a-417d-849d-1b6ac35f0708 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:29.038402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:29.039619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:29.040123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:29.040496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] PATH_INFO: `/v3/projects/156eb332f91b4469869ddf2be17c33e0/users/a8e8a315c1bb4d0e8012616b3decabc9/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:29.059825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=156eb332f91b4469869ddf2be17c33e0, user_id=a8e8a315c1bb4d0e8012616b3decabc9, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:29.074188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:29.084115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:29.127242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 850/1720] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:28 2022] PUT /identity/v3/projects/156eb332f91b4469869ddf2be17c33e0/users/a8e8a315c1bb4d0e8012616b3decabc9/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:29.128317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:29.132290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:29.183048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf7b2c-60b7-4d34-8598-a4df13a078b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:29.183822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf7b2c-60b7-4d34-8598-a4df13a078b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:29.184113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf7b2c-60b7-4d34-8598-a4df13a078b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:29.184382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf7b2c-60b7-4d34-8598-a4df13a078b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:29.185163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf7b2c-60b7-4d34-8598-a4df13a078b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:29.199027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf7b2c-60b7-4d34-8598-a4df13a078b3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:29.251064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 871/1721] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:28 2022] POST /identity/v3/users => generated 299 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:29.252471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ac42-44f0-4172-9d7b-4f0b79b4caff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:29.255018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ac42-44f0-4172-9d7b-4f0b79b4caff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:29.255313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ac42-44f0-4172-9d7b-4f0b79b4caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:29.363285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8696e28-a4f4-44bd-92ba-de35d4ea02dd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:29.422655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73bb31-40ab-4d11-81eb-eb270feadc1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:29.426747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bb31-40ab-4d11-81eb-eb270feadc1c service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:29.429023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bb31-40ab-4d11-81eb-eb270feadc1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:29.432857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bb31-40ab-4d11-81eb-eb270feadc1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:29.435568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4de6ac42-44f0-4172-9d7b-4f0b79b4caff None None] MFA Rules not processed for user `a8e8a315c1bb4d0e8012616b3decabc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:29.441376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7c73bb31-40ab-4d11-81eb-eb270feadc1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:29.447925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4de6ac42-44f0-4172-9d7b-4f0b79b4caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:29.531876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:29.708181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73bb31-40ab-4d11-81eb-eb270feadc1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:29.715038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73bb31-40ab-4d11-81eb-eb270feadc1c service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:29.732119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 872/1722] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:29.734561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6ac42-44f0-4172-9d7b-4f0b79b4caff None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:29.774394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 851/1723] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:29.784443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356abd45-c283-4375-b76d-6af1da6510d8 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:29.785383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356abd45-c283-4375-b76d-6af1da6510d8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:29.790844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356abd45-c283-4375-b76d-6af1da6510d8 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:29.799288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 852/1724] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:02:29 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:29.801824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356abd45-c283-4375-b76d-6af1da6510d8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:29.811400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-356abd45-c283-4375-b76d-6af1da6510d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:30.179586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6ac42-44f0-4172-9d7b-4f0b79b4caff None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:30.193701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356abd45-c283-4375-b76d-6af1da6510d8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:30.199045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:30.201037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.201337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.203855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.205310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:30.205980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.206302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.213762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:30.215990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] PATH_INFO: `/v3/users/2ae61ae780314ecc93bf72f7845486f0` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.221816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae61ae780314ecc93bf72f7845486f0)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:30.222628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:30.228697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:30.278072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 873/1725] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:30.279439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.327827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6e70f-6057-4801-82ab-27e6d2383a58 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:30.364641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0865f9-419a-46af-86bf-286b81a599d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:30.366848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0865f9-419a-46af-86bf-286b81a599d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.367361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0865f9-419a-46af-86bf-286b81a599d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.369553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0865f9-419a-46af-86bf-286b81a599d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.372874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0865f9-419a-46af-86bf-286b81a599d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:30.390316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0865f9-419a-46af-86bf-286b81a599d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:30.490420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae61ae780314ecc93bf72f7845486f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:30.557821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae61ae780314ecc93bf72f7845486f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:30.583758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 874/1726] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:30 2022] POST /identity/v3/projects => generated 389 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:30.586908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.587472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.587472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.613552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae61ae780314ecc93bf72f7845486f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:30.652678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae61ae780314ecc93bf72f7845486f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:30.653685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae61ae780314ecc93bf72f7845486f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:30.659683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:30.663871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:30.664404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 853/1727] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:29 2022] DELETE /identity/v3/users/2ae61ae780314ecc93bf72f7845486f0 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:30.686228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.691458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:30.724974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:30.830797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 875/1728] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:30.831988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.834778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:30.952852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.021372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a3da-f9de-4a13-a212-05122f339a48 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.035164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.038557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3eb7-1cd5-488f-9037-e921b35e8155 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.039745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.041038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.041561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] PATH_INFO: `/v3/projects/dcac785bbcce4fedb31f3961094d2573/users/a3b1c77f7fd84a2ab3f8306a04318ace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.056843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcaed4-38b4-4704-b625-02786f39fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.059371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcaed4-38b4-4704-b625-02786f39fdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.060320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcaed4-38b4-4704-b625-02786f39fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.061041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcaed4-38b4-4704-b625-02786f39fdd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.065286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcaed4-38b4-4704-b625-02786f39fdd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.072522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcaed4-38b4-4704-b625-02786f39fdd1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.083220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac785bbcce4fedb31f3961094d2573, user_id=a3b1c77f7fd84a2ab3f8306a04318ace, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.087074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.124779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 876/1730] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:30 2022] POST /identity/v3/users => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:31.126295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002cf46-5f2e-4df5-948d-abf62d4ac5b6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.126593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002cf46-5f2e-4df5-948d-abf62d4ac5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.126872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002cf46-5f2e-4df5-948d-abf62d4ac5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.128641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 854/1730] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:30 2022] PUT /identity/v3/projects/dcac785bbcce4fedb31f3961094d2573/users/a3b1c77f7fd84a2ab3f8306a04318ace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:31.130385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.136113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:31.164534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1002cf46-5f2e-4df5-948d-abf62d4ac5b6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:31.168394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1002cf46-5f2e-4df5-948d-abf62d4ac5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:31.338482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 877/1731] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:31.338482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002cf46-5f2e-4df5-948d-abf62d4ac5b6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.357586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002cf46-5f2e-4df5-948d-abf62d4ac5b6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.371282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.371661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.371924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.372188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.372928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.374698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.397441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 878/1732] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:31.398581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.423692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d208a-b79d-434d-86b1-cb39dba631ec admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.433321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.436400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.436998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.437651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.440042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.444520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.460753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f0f70-abce-42ac-b09a-ff5e8e486899 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.470970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 879/1733] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:31.472999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.477276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.477803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:31.478098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.478246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.478534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.496841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.500966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.525627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 855/1734] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:31.533273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.563003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c44b-8607-40a5-8898-2c761dbfa464 service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.582736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.583676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.584091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.584731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] PATH_INFO: `/v3/projects/dcac785bbcce4fedb31f3961094d2573/users/a3b1c77f7fd84a2ab3f8306a04318ace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.590827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac785bbcce4fedb31f3961094d2573, user_id=a3b1c77f7fd84a2ab3f8306a04318ace, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.593948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.598266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.631630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 856/1735] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:31 2022] PUT /identity/v3/projects/dcac785bbcce4fedb31f3961094d2573/users/a3b1c77f7fd84a2ab3f8306a04318ace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:31.634410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.659726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e55fd2-0d20-4277-8264-bc86a7882fcb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.770345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8da6c-4755-4980-a0ce-d69605262c35 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.775361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084faa94-2ad9-4190-ae52-70d968595aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.776511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084faa94-2ad9-4190-ae52-70d968595aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.776805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084faa94-2ad9-4190-ae52-70d968595aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.777086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084faa94-2ad9-4190-ae52-70d968595aab admin admin] PATH_INFO: `/v3/projects/a498f2e63feb4e72a56b1a982b0c7f86/users/989cbeb46ecc43d38a84bc672c6a8140/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.797057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084faa94-2ad9-4190-ae52-70d968595aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a498f2e63feb4e72a56b1a982b0c7f86, user_id=989cbeb46ecc43d38a84bc672c6a8140, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.800067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084faa94-2ad9-4190-ae52-70d968595aab admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.807325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade47ca-b791-4f54-8d35-445c31846fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.814048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade47ca-b791-4f54-8d35-445c31846fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.815942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade47ca-b791-4f54-8d35-445c31846fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.816644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade47ca-b791-4f54-8d35-445c31846fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.823743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 857/1736] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:31 2022] PUT /identity/v3/projects/a498f2e63feb4e72a56b1a982b0c7f86/users/989cbeb46ecc43d38a84bc672c6a8140/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:31.825764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d06e-53a3-4ffe-aab4-3db0001e6f8d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.825764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d06e-53a3-4ffe-aab4-3db0001e6f8d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.825935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d06e-53a3-4ffe-aab4-3db0001e6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.845794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade47ca-b791-4f54-8d35-445c31846fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.847382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade47ca-b791-4f54-8d35-445c31846fc8 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.882547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 880/1737] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:31.884555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5344d06e-53a3-4ffe-aab4-3db0001e6f8d None None] MFA Rules not processed for user `a3b1c77f7fd84a2ab3f8306a04318ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:31.885804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5344d06e-53a3-4ffe-aab4-3db0001e6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:31.887175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.887557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.887909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.903123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.926938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] MFA Rules not processed for user `2fa3a98382cd4b04bb384bbc2ab3a598`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:31.928196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:32.050639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 858/1738] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:32.057537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d06e-53a3-4ffe-aab4-3db0001e6f8d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.101975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 881/1739] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jun 3 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:32.114081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.122946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:32.180233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d06e-53a3-4ffe-aab4-3db0001e6f8d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.190527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.191626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.192131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.192471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.193400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.195320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.209682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 859/1740] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:32.210899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.214581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:32.274705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e1d-a72d-46b0-9a41-251512b73491 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.292775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.301713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.307487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.308007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.332909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.337172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.373326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccf573-b2e7-4a15-9887-a466f3772eea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.395319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542acca-c6d6-495a-9858-fb5e64adb96e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.395667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542acca-c6d6-495a-9858-fb5e64adb96e service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.395986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542acca-c6d6-495a-9858-fb5e64adb96e service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.396279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542acca-c6d6-495a-9858-fb5e64adb96e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.410492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542acca-c6d6-495a-9858-fb5e64adb96e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.413191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542acca-c6d6-495a-9858-fb5e64adb96e service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.415249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 860/1741] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:32.429886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.459963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 882/1742] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:32.483032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53167-bc4c-4027-bfc2-b82ef0df8141 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.492822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.493921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.494310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.494835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] PATH_INFO: `/v3/projects/a498f2e63feb4e72a56b1a982b0c7f86/users/989cbeb46ecc43d38a84bc672c6a8140/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.497883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a498f2e63feb4e72a56b1a982b0c7f86, user_id=989cbeb46ecc43d38a84bc672c6a8140, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.501430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.528590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 861/1743] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:32 2022] PUT /identity/v3/projects/a498f2e63feb4e72a56b1a982b0c7f86/users/989cbeb46ecc43d38a84bc672c6a8140/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:32.529454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308a57-dce1-4734-85cb-363db8725c8c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.529809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308a57-dce1-4734-85cb-363db8725c8c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.530093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308a57-dce1-4734-85cb-363db8725c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.577253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-09308a57-dce1-4734-85cb-363db8725c8c None None] MFA Rules not processed for user `989cbeb46ecc43d38a84bc672c6a8140`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:32.578594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-09308a57-dce1-4734-85cb-363db8725c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:32.609228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.701955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.764102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd1ec2-7cca-4a16-8154-d288851d1a15 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.770785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.771894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.772191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.773314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] PATH_INFO: `/v3/users/59ee22a7276545deacb8456345a2d81e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.775295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ee22a7276545deacb8456345a2d81e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.778404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.805100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 883/1744] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:32.820274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308a57-dce1-4734-85cb-363db8725c8c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.848338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.910835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ee22a7276545deacb8456345a2d81e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:32.937299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ee22a7276545deacb8456345a2d81e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:32.990960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ee22a7276545deacb8456345a2d81e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.025861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308a57-dce1-4734-85cb-363db8725c8c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.046637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ee22a7276545deacb8456345a2d81e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.047746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a35cd-5933-4927-97c7-bcb7a15dca72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.048766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a35cd-5933-4927-97c7-bcb7a15dca72 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.049261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a35cd-5933-4927-97c7-bcb7a15dca72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.050270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a35cd-5933-4927-97c7-bcb7a15dca72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.054176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ee22a7276545deacb8456345a2d81e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.081432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 862/1745] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:32 2022] DELETE /identity/v3/users/59ee22a7276545deacb8456345a2d81e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:33.081432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.084288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a35cd-5933-4927-97c7-bcb7a15dca72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.086066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a35cd-5933-4927-97c7-bcb7a15dca72 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.092510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.106889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 884/1746] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:33.110540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.111275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.111995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.146800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:33.151724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.284411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a477-a26f-4941-a1b9-14a131406157 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.301990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.303546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.303688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.304038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] PATH_INFO: `/v3/users/73e5dfadff744e68bfaeff37151c4469` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.305424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e5dfadff744e68bfaeff37151c4469)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.307933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.318552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 885/1747] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:33.319668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.321180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.354213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666af1-4a0e-4d29-8323-73a1d7671479 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.374534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.375474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.376030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.376557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] PATH_INFO: `/v3/users/a8e8a315c1bb4d0e8012616b3decabc9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.381189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e8a315c1bb4d0e8012616b3decabc9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.384545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.404627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e5dfadff744e68bfaeff37151c4469'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.417076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e5dfadff744e68bfaeff37151c4469'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.433109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e5dfadff744e68bfaeff37151c4469'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.471649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e5dfadff744e68bfaeff37151c4469'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.472510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e5dfadff744e68bfaeff37151c4469'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.490771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 863/1748] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:33 2022] DELETE /identity/v3/users/73e5dfadff744e68bfaeff37151c4469 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:33.493497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.497614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.505243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e8a315c1bb4d0e8012616b3decabc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.523471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e8a315c1bb4d0e8012616b3decabc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.553279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e8a315c1bb4d0e8012616b3decabc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.558693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.577547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.580977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e8a315c1bb4d0e8012616b3decabc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.582033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d692175d-ced0-49fd-8ddb-1ea5313d0283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e8a315c1bb4d0e8012616b3decabc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:33.595866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 886/1749] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:33 2022] DELETE /identity/v3/users/a8e8a315c1bb4d0e8012616b3decabc9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:33.601683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89051776-869b-4510-ae86-3ec670309dfb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.602629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89051776-869b-4510-ae86-3ec670309dfb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.603146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89051776-869b-4510-ae86-3ec670309dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.630645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-89051776-869b-4510-ae86-3ec670309dfb None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:33.634166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89051776-869b-4510-ae86-3ec670309dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.661997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dcbd7-2690-4021-a60a-bb7241c2b1d8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.724739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 887/1750] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:33.769768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89051776-869b-4510-ae86-3ec670309dfb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.771612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89051776-869b-4510-ae86-3ec670309dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.781638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.782403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.782695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.783008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.795965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.814297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.815764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.836982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 864/1751] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:33.936897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89051776-869b-4510-ae86-3ec670309dfb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.005737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390211e7-adb9-451a-adce-685052801f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.006516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390211e7-adb9-451a-adce-685052801f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.006841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390211e7-adb9-451a-adce-685052801f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.007262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390211e7-adb9-451a-adce-685052801f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.039322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390211e7-adb9-451a-adce-685052801f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:34.045309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390211e7-adb9-451a-adce-685052801f53 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:34.100470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 888/1752] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:34.915708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.918209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:34.955455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6c3a1-07f4-469d-8483-06e4d4669f1f service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.971531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.972419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.973084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.973084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] PATH_INFO: `/v3/projects/b7b09c0fea9649f6b72900eae1548fe6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.974858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b09c0fea9649f6b72900eae1548fe6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:34.977275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.127299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b09c0fea9649f6b72900eae1548fe6', 'request_id': 'req-3ac27388-a855-4af3-aa57-b90c7734d6cd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.159035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b09c0fea9649f6b72900eae1548fe6', 'request_id': 'req-3ac27388-a855-4af3-aa57-b90c7734d6cd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.182510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b09c0fea9649f6b72900eae1548fe6', 'request_id': 'req-3ac27388-a855-4af3-aa57-b90c7734d6cd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.197224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] The token cache is being invalidate because project b7b09c0fea9649f6b72900eae1548fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:35.198784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.201101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ac27388-a855-4af3-aa57-b90c7734d6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.204776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 865/1753] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:34 2022] DELETE /identity/v3/projects/b7b09c0fea9649f6b72900eae1548fe6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:35.209688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.210678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.211299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.285175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:35.290016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:35.323536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e57c8-db61-4d8b-b524-b7c79df6f1ad None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.324459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e57c8-db61-4d8b-b524-b7c79df6f1ad None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.325069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e57c8-db61-4d8b-b524-b7c79df6f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.447223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f40e57c8-db61-4d8b-b524-b7c79df6f1ad None None] MFA Rules not processed for user `f2217b3c134d453fbdcb14853eed4e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:35.450045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f40e57c8-db61-4d8b-b524-b7c79df6f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:35.562233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 889/1754] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:35.563753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:35.565516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:35.598878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d9cd-17a2-496a-a838-d6e2c55383c1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.607762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.608945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.609441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.610626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] PATH_INFO: `/v3/users/5061eb599046423795eb571ebd2b99b1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.612258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5061eb599046423795eb571ebd2b99b1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:35.614634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.645531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:35.678728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:35.717958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 866/1755] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:35.719746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.720046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.724228 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5061eb599046423795eb571ebd2b99b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.725056 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.745555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5061eb599046423795eb571ebd2b99b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.770454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5061eb599046423795eb571ebd2b99b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.774717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:35.776003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:35.795813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5061eb599046423795eb571ebd2b99b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.799326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5061eb599046423795eb571ebd2b99b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:35.800208 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 867/1756] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:35.801121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:35.802568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:35.824181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 890/1757] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:35 2022] DELETE /identity/v3/users/5061eb599046423795eb571ebd2b99b1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:35.825642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:35.829823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:35.992054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270eedb-b61e-4188-93b3-194f6b4ec9ba admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.993385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687a92e-2d07-4b12-a4bb-a376692b509e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.998979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5296a-2de2-4c54-a534-b3e4dd5fe99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.999966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5296a-2de2-4c54-a534-b3e4dd5fe99e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.000933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5296a-2de2-4c54-a534-b3e4dd5fe99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.001364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5296a-2de2-4c54-a534-b3e4dd5fe99e admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.002851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5296a-2de2-4c54-a534-b3e4dd5fe99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:36.003332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5296a-2de2-4c54-a534-b3e4dd5fe99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:36.006054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5296a-2de2-4c54-a534-b3e4dd5fe99e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:36.030618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 891/1758] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:36.036518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.037169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.037760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.084565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:36.106000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:36.106967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.107650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.107933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.110691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.112173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.138431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 892/1759] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:36.139156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:36.143407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.195334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:36.197943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:36.211753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43354891-5a7b-431e-a6fd-a588fb37dff8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:36.239011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 868/1760] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:36.242196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:36.269880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:36.270959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.271307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.271606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] PATH_INFO: `/v3/projects/0c8b3445c26a41708f63d81b13f86483` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.273571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8b3445c26a41708f63d81b13f86483)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:36.277863 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:36.278286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bbac2-d5a0-44f0-a222-6ef8260ecb1a service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:36.294742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:36.295881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.299643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.300614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.303813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:36.310453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:36.358484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:36.384560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 869/1761] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:36 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:36.387242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:36.389851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.484008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8b3445c26a41708f63d81b13f86483', 'request_id': 'req-ffba5842-e5ea-4333-a026-d8f81602998f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:36.521047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8b3445c26a41708f63d81b13f86483', 'request_id': 'req-ffba5842-e5ea-4333-a026-d8f81602998f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:36.575903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8ad7-c632-49dd-8336-26bbd22a08da admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:36.589221 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8b3445c26a41708f63d81b13f86483', 'request_id': 'req-ffba5842-e5ea-4333-a026-d8f81602998f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:36.623778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] The token cache is being invalidate because project 0c8b3445c26a41708f63d81b13f86483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:36.624084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:36.631008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:36.638412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 893/1762] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:36 2022] DELETE /identity/v3/projects/0c8b3445c26a41708f63d81b13f86483 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:36.638895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:36.643123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.705071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:36.756388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:36.760271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.761389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.763109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] PATH_INFO: `/v3/projects/3571df9f9c654b6ba76d5abba5b66137` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.769617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3571df9f9c654b6ba76d5abba5b66137)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:36.777418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:36.810809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba5842-e5ea-4333-a026-d8f81602998f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:36.821794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:36.822952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.825402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.826365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.832202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.874377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:36.878711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:36.908334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 894/1763] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:36.910512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:36.917439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.930766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3571df9f9c654b6ba76d5abba5b66137', 'request_id': 'req-4684512d-e8c6-4bb0-91eb-383d289e115b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:36.946788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa941c-cea1-478d-a119-7788274c5194 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:36.948071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3571df9f9c654b6ba76d5abba5b66137', 'request_id': 'req-4684512d-e8c6-4bb0-91eb-383d289e115b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:36.967808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3571df9f9c654b6ba76d5abba5b66137', 'request_id': 'req-4684512d-e8c6-4bb0-91eb-383d289e115b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.021566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] The token cache is being invalidate because project 3571df9f9c654b6ba76d5abba5b66137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:37.023005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.025616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.031374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 870/1764] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:36 2022] DELETE /identity/v3/projects/3571df9f9c654b6ba76d5abba5b66137 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:37.034575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.039146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:37.149871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.150141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.151986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.152429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.153946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.156667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.163239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.218513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 895/1765] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:36 2022] POST /identity/v3/users => generated 289 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:37.218513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.222528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:37.244284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684512d-e8c6-4bb0-91eb-383d289e115b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.261860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.264283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393aea-5560-416b-af8d-a0f300add669 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.265458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.265998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.266333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] PATH_INFO: `/v3/users/2328cde208af4f29b1b0fc8dba52c5c1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.268077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2328cde208af4f29b1b0fc8dba52c5c1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.273483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.280091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.281975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.283337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.283636 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] PATH_INFO: `/v3/users/a3b1c77f7fd84a2ab3f8306a04318ace` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.287823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b1c77f7fd84a2ab3f8306a04318ace)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.292070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.422338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2328cde208af4f29b1b0fc8dba52c5c1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.431794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b1c77f7fd84a2ab3f8306a04318ace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.447385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b1c77f7fd84a2ab3f8306a04318ace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.451641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2328cde208af4f29b1b0fc8dba52c5c1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.467016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b1c77f7fd84a2ab3f8306a04318ace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.483852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2328cde208af4f29b1b0fc8dba52c5c1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.534360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b1c77f7fd84a2ab3f8306a04318ace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.536820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-13b8310d-da7d-450c-855b-2cd365cf8d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b1c77f7fd84a2ab3f8306a04318ace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.547962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2328cde208af4f29b1b0fc8dba52c5c1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.554848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2328cde208af4f29b1b0fc8dba52c5c1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:37.567072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 896/1766] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:37 2022] DELETE /identity/v3/users/a3b1c77f7fd84a2ab3f8306a04318ace => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:37.571565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777132d3-cab0-4ffd-be01-d10cc2f807d8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.571884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777132d3-cab0-4ffd-be01-d10cc2f807d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.572163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777132d3-cab0-4ffd-be01-d10cc2f807d8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.578777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 871/1767] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:37 2022] DELETE /identity/v3/users/2328cde208af4f29b1b0fc8dba52c5c1 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:37.580865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 897/1768] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:02:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:37.581043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.584822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:37.667238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bdef2-12b4-4d7a-88b7-00552948c66f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.667645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bdef2-12b4-4d7a-88b7-00552948c66f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.667987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bdef2-12b4-4d7a-88b7-00552948c66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.709778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-229bdef2-12b4-4d7a-88b7-00552948c66f None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:37.712039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-229bdef2-12b4-4d7a-88b7-00552948c66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:37.775848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.805067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f3c48-c244-467f-80a9-ff369cc0aa10 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.822581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.823688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.823688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.823864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.826094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.829819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.881004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 872/1769] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:37.886199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.900554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8b41e-9e3a-4351-818f-52da7819d005 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.948902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646e7e-7078-4345-a216-550a4bf926c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.949610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646e7e-7078-4345-a216-550a4bf926c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.949902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646e7e-7078-4345-a216-550a4bf926c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.952370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646e7e-7078-4345-a216-550a4bf926c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.954648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646e7e-7078-4345-a216-550a4bf926c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.960170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646e7e-7078-4345-a216-550a4bf926c0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.967738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 898/1770] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:37.988448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 873/1771] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:37.992933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bdef2-12b4-4d7a-88b7-00552948c66f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.022740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bdef2-12b4-4d7a-88b7-00552948c66f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.055852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.056767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.057060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.057519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] PATH_INFO: `/v3/projects/17c0b153c86e4a90ae2454fc7879fbbd/users/4a2e472fbb8a465bac22c2edeb028aab/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.130010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c0b153c86e4a90ae2454fc7879fbbd, user_id=4a2e472fbb8a465bac22c2edeb028aab, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.132810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.185701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 899/1772] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:37 2022] PUT /identity/v3/projects/17c0b153c86e4a90ae2454fc7879fbbd/users/4a2e472fbb8a465bac22c2edeb028aab/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:38.197892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.199961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.202257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.255457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.257810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:38.296997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] MFA Rules not processed for user `4a2e472fbb8a465bac22c2edeb028aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:38.301724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:38.383556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:38.469793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb73226-6d95-4dd8-bd3e-58bef7e79e63 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.493200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.494043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.494359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.494807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.510644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 874/1773] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:38.511565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.513386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:38.521908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.525496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.561141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 900/1774] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:38.564463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.727835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dee4c2-8ecc-422a-8545-ea0b7b9a8c96 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.736826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.738553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.738841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.739178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] PATH_INFO: `/v3/projects/156eb332f91b4469869ddf2be17c33e0` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.749301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] RBAC: Authorizing `identity:delete_project(project_id=156eb332f91b4469869ddf2be17c33e0)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.751392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.760859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a24cd-2afa-4c1b-947c-d029ab88ae7a service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.798354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.799649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.799649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.800052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.801097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.803444 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.901708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:38.915238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 901/1775] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:38 2022] POST /identity/v3/projects => generated 377 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:38.919839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.995366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156eb332f91b4469869ddf2be17c33e0', 'request_id': 'req-0578abbb-dd30-4a45-b136-ed1248b5741a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.016036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156eb332f91b4469869ddf2be17c33e0', 'request_id': 'req-0578abbb-dd30-4a45-b136-ed1248b5741a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.032764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156eb332f91b4469869ddf2be17c33e0', 'request_id': 'req-0578abbb-dd30-4a45-b136-ed1248b5741a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.058805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09dfbb-e597-40df-b205-ff64ff9fe717 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.061290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] The token cache is being invalidate because project 156eb332f91b4469869ddf2be17c33e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:39.063539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.066998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.071644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 875/1776] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:38 2022] DELETE /identity/v3/projects/156eb332f91b4469869ddf2be17c33e0 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:39.081495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.083908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.171495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.172422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.172800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.173164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.173910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.176548 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.208549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.215121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578abbb-dd30-4a45-b136-ed1248b5741a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.217595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 902/1777] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:38 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:39.222270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.224466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.228440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.229615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.233326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.234534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] PATH_INFO: `/v3/users/989cbeb46ecc43d38a84bc672c6a8140` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.236468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] RBAC: Authorizing `identity:delete_user(user_id=989cbeb46ecc43d38a84bc672c6a8140)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.238322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.260563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ecabf-88ed-4d54-b5ad-d34faf0b9cde admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.269635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.271010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.271307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.271599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.272398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.275170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.290005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 903/1778] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:39.291683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.294496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.324505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee747fdb-2e05-4a4a-8a10-da0f29f1a813 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.343345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.345610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.345857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989cbeb46ecc43d38a84bc672c6a8140'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.347039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.347420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] PATH_INFO: `/v3/projects/09d29b2488064263b1b950566d11c885` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.353519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d29b2488064263b1b950566d11c885)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.358913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989cbeb46ecc43d38a84bc672c6a8140'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.359076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.378818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989cbeb46ecc43d38a84bc672c6a8140'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.409443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989cbeb46ecc43d38a84bc672c6a8140'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.410755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989cbeb46ecc43d38a84bc672c6a8140'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.424222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 876/1779] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:39 2022] DELETE /identity/v3/users/989cbeb46ecc43d38a84bc672c6a8140 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:39.429351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.433470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.461363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d29b2488064263b1b950566d11c885', 'request_id': 'req-ec0cf4da-a873-4938-8454-dcf8163bb7a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.470030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d29b2488064263b1b950566d11c885', 'request_id': 'req-ec0cf4da-a873-4938-8454-dcf8163bb7a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.495132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d29b2488064263b1b950566d11c885', 'request_id': 'req-ec0cf4da-a873-4938-8454-dcf8163bb7a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.511631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] The token cache is being invalidate because project 09d29b2488064263b1b950566d11c885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:39.512214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.513475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ec0cf4da-a873-4938-8454-dcf8163bb7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:39.515769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 904/1780] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:39 2022] DELETE /identity/v3/projects/09d29b2488064263b1b950566d11c885 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:39.523761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12083aa-0696-4d7b-bc8b-a241bc236017 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.524062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12083aa-0696-4d7b-bc8b-a241bc236017 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.524347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12083aa-0696-4d7b-bc8b-a241bc236017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.557288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.572602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a12083aa-0696-4d7b-bc8b-a241bc236017 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:39.576476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a12083aa-0696-4d7b-bc8b-a241bc236017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.613439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bf078-d925-486d-8698-aae486c2511e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.698450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 905/1781] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:39.700146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53566e9-d197-4b6e-bb01-fe61705603b3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.700548 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53566e9-d197-4b6e-bb01-fe61705603b3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.701176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53566e9-d197-4b6e-bb01-fe61705603b3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.702926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 906/1782] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:39.705760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c9c4-c3a5-44bf-a954-4de5a9db1943 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.706281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c9c4-c3a5-44bf-a954-4de5a9db1943 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.706682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c9c4-c3a5-44bf-a954-4de5a9db1943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.726822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d249c9c4-c3a5-44bf-a954-4de5a9db1943 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:39.728353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d249c9c4-c3a5-44bf-a954-4de5a9db1943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.738675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 907/1783] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:39.743500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.744074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.744618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.760888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.761812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.762103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.767448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] PATH_INFO: `/v3/projects/b533a357b2b74ee5a3271096d8d1ca21/users/4cd650f90ef042848a8724a9fd5bfed0/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.771619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:39.773469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.806742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b533a357b2b74ee5a3271096d8d1ca21, user_id=4cd650f90ef042848a8724a9fd5bfed0, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.809653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.844023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 877/1784] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:39 2022] PUT /identity/v3/projects/b533a357b2b74ee5a3271096d8d1ca21/users/4cd650f90ef042848a8724a9fd5bfed0/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:39.845148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.858709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.892204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 908/1785] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:39.895658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.899766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:39.925270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d4b6f-b89a-46f1-9a2c-7c3171185825 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.005401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28835154-5e4e-45fa-926b-2a00bba26819 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.011725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.013875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.014532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.014847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.016287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:40.018127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.020518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.041276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 878/1786] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:40.042453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.044277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:40.074522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.075214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.075500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.075775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.076571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.078428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.093088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 909/1787] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:40.094138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.106997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eda51d-d5c8-4c10-bcda-7fd394f7fd59 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.122229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.124025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.124324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.124607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.126338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.128867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.163113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afbf7b-fe5a-4d8e-be1d-6ac9b25cdde8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.170426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.171570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.172231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.172638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.177684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 910/1788] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:40 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:40.178967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.187187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.189331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.194729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:40.222188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 879/1789] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:40.226528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.263037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c2363-735e-4675-985d-6bb78a38a253 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.360796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6161-adb9-41e8-8735-bad30240df73 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.369248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beadf8-ac64-427f-843e-95bb13ae5f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.371040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beadf8-ac64-427f-843e-95bb13ae5f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.371580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beadf8-ac64-427f-843e-95bb13ae5f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.372224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beadf8-ac64-427f-843e-95bb13ae5f40 admin admin] PATH_INFO: `/v3/projects/b533a357b2b74ee5a3271096d8d1ca21/users/4cd650f90ef042848a8724a9fd5bfed0/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.375156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beadf8-ac64-427f-843e-95bb13ae5f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b533a357b2b74ee5a3271096d8d1ca21, user_id=4cd650f90ef042848a8724a9fd5bfed0, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.378674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beadf8-ac64-427f-843e-95bb13ae5f40 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.407190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 911/1790] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:40 2022] PUT /identity/v3/projects/b533a357b2b74ee5a3271096d8d1ca21/users/4cd650f90ef042848a8724a9fd5bfed0/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:40.409033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2dd71-bb55-4db9-9cae-6285efff7e7d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.409432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2dd71-bb55-4db9-9cae-6285efff7e7d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.409954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2dd71-bb55-4db9-9cae-6285efff7e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.436265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.437408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.437754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.438075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.439163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.445135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.449279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eff2dd71-bb55-4db9-9cae-6285efff7e7d None None] MFA Rules not processed for user `4cd650f90ef042848a8724a9fd5bfed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:40.451487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eff2dd71-bb55-4db9-9cae-6285efff7e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:40.486656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 880/1791] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:40 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:40.487973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.499493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:40.552649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc01f3f-75f7-45b5-91fc-1a4a28a4ca8f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.579156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:40.653407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 912/1792] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:40.656435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2dd71-bb55-4db9-9cae-6285efff7e7d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.697613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.698553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.698841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.699119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] PATH_INFO: `/v3/projects/a732df7a48b44ca3b0b47cdc196c29b2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.705164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a732df7a48b44ca3b0b47cdc196c29b2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.707484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.788211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2dd71-bb55-4db9-9cae-6285efff7e7d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.819221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a732df7a48b44ca3b0b47cdc196c29b2', 'request_id': 'req-888a24e4-f938-4db2-ae15-d84c897b3d16'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:40.832797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a732df7a48b44ca3b0b47cdc196c29b2', 'request_id': 'req-888a24e4-f938-4db2-ae15-d84c897b3d16'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:40.852339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a732df7a48b44ca3b0b47cdc196c29b2', 'request_id': 'req-888a24e4-f938-4db2-ae15-d84c897b3d16'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:40.853117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:40.873881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] The token cache is being invalidate because project a732df7a48b44ca3b0b47cdc196c29b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:40.874089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:40.877285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:40.880532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 881/1793] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:40 2022] DELETE /identity/v3/projects/a732df7a48b44ca3b0b47cdc196c29b2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:40.882255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.886618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:40.914805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.915780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.918149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.918448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.920222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.922787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.957432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 913/1794] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:40.958666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.962550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:40.977142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0eab2-31ed-4853-a523-2973c6db7cde admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.983797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.985016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.985586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.985931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] PATH_INFO: `/v3/users/d403474951f9465090e2d0a675f22846` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.987415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d403474951f9465090e2d0a675f22846)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.989776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.993464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a24e4-f938-4db2-ae15-d84c897b3d16 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.997590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.998530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.998887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.999234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.001412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.088464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.090407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.100141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.117336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 882/1795] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:41.124467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd403474951f9465090e2d0a675f22846'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.125227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.142719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.163846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd403474951f9465090e2d0a675f22846'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.171530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732bac4-18ef-4bf0-96dc-33dc7cff8078 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.184141 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd403474951f9465090e2d0a675f22846'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.186458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.187337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.188137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.188546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.189896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.191731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.222312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd403474951f9465090e2d0a675f22846'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.223351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd403474951f9465090e2d0a675f22846'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.242782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 914/1796] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:40 2022] DELETE /identity/v3/users/d403474951f9465090e2d0a675f22846 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:41.243916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.245442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.250199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 883/1797] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:41.260490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.271409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.298456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0298c-31ca-421d-97c4-a5503ef706dd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.407802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11162efb-be26-422c-be8b-46f0b337a832 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.424153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.425580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.425866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.426589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] PATH_INFO: `/v3/projects/dcac785bbcce4fedb31f3961094d2573` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.427977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcac785bbcce4fedb31f3961094d2573)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.430276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.440649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec72bf2-2c6b-4f2e-8f0d-f69c889d0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.442467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72bf2-2c6b-4f2e-8f0d-f69c889d0187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.442898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72bf2-2c6b-4f2e-8f0d-f69c889d0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.443402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72bf2-2c6b-4f2e-8f0d-f69c889d0187 admin admin] PATH_INFO: `/v3/projects/cf968796dff347c9bd0af2b4238be2dd/users/275b6f21637d40ca83c8119d58932b25/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.468923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec72bf2-2c6b-4f2e-8f0d-f69c889d0187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf968796dff347c9bd0af2b4238be2dd, user_id=275b6f21637d40ca83c8119d58932b25, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.473721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec72bf2-2c6b-4f2e-8f0d-f69c889d0187 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.500354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 884/1798] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:41 2022] PUT /identity/v3/projects/cf968796dff347c9bd0af2b4238be2dd/users/275b6f21637d40ca83c8119d58932b25/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:41.511981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.512301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.512536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.559716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] MFA Rules not processed for user `275b6f21637d40ca83c8119d58932b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:41.561416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.569529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.577549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcac785bbcce4fedb31f3961094d2573', 'request_id': 'req-f817b8e2-82a5-4e31-bed5-825b5502ce3d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.589127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcac785bbcce4fedb31f3961094d2573', 'request_id': 'req-f817b8e2-82a5-4e31-bed5-825b5502ce3d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.617523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcac785bbcce4fedb31f3961094d2573', 'request_id': 'req-f817b8e2-82a5-4e31-bed5-825b5502ce3d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.680504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] The token cache is being invalidate because project dcac785bbcce4fedb31f3961094d2573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:41.680817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.681965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f817b8e2-82a5-4e31-bed5-825b5502ce3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:41.689359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 915/1799] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:41 2022] DELETE /identity/v3/projects/dcac785bbcce4fedb31f3961094d2573 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:41.692594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d7e6-8feb-4853-8689-23258217a24d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.692879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d7e6-8feb-4853-8689-23258217a24d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.693164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d7e6-8feb-4853-8689-23258217a24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.731224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-41a8d7e6-8feb-4853-8689-23258217a24d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:41.732809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41a8d7e6-8feb-4853-8689-23258217a24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.766928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 885/1800] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:41.772871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.775319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.871703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89200e44-7be7-4e9e-b70a-ea1318738ba7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.879038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.880024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.880559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.881044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.882191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.885342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.890061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.928806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 916/1801] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:41.933348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f492-7622-4e3f-a001-68ddeb33bbe0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.933884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f492-7622-4e3f-a001-68ddeb33bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.934343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f492-7622-4e3f-a001-68ddeb33bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.939770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 886/1802] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:41 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:41.946913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.969461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f021f492-7622-4e3f-a001-68ddeb33bbe0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:41.971414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f021f492-7622-4e3f-a001-68ddeb33bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.027961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3da52-1895-4475-ad1f-eb8d531a2a80 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.045089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.048026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.049984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.050356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.051091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.053071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.102156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 887/1803] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:41 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:42.108394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.112570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.123384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 917/1804] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:42.124748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f492-7622-4e3f-a001-68ddeb33bbe0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.131462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5005321-d855-4176-935f-debc479376e5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.138611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.139642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.140021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.140430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] PATH_INFO: `/v3/projects/a498f2e63feb4e72a56b1a982b0c7f86` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.149800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f492-7622-4e3f-a001-68ddeb33bbe0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.157342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.158200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.158692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.159077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.160290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.160847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a498f2e63feb4e72a56b1a982b0c7f86)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.162024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.163944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.189392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 918/1805] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:42.189392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.206652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231026c-bae2-404e-8d0e-c1fdea2ad688 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.224161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.224891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.225226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.225516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.226482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:42.227333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.233387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.262625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a498f2e63feb4e72a56b1a982b0c7f86', 'request_id': 'req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.267040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 919/1806] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:42.270713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.276297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a498f2e63feb4e72a56b1a982b0c7f86', 'request_id': 'req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.282736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de2c4-e6d1-4dba-9bf7-afb7757cd50f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.290950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a498f2e63feb4e72a56b1a982b0c7f86', 'request_id': 'req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.306709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] The token cache is being invalidate because project a498f2e63feb4e72a56b1a982b0c7f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:42.307018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.308035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.310502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 888/1807] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:42 2022] DELETE /identity/v3/projects/a498f2e63feb4e72a56b1a982b0c7f86 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:42.311348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.312963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.352224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.377653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.378686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.378914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.380285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] PATH_INFO: `/v3/projects/88ab15bd437b46c5a72c4f69da037154/users/b3e5abc0dab44fb7bac004904e07f9c6/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.403378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ab15bd437b46c5a72c4f69da037154, user_id=b3e5abc0dab44fb7bac004904e07f9c6, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.405918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.416895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.425953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 920/1808] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:42 2022] PUT /identity/v3/projects/88ab15bd437b46c5a72c4f69da037154/users/b3e5abc0dab44fb7bac004904e07f9c6/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:42.427733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.430042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.430422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b66b-0564-4ceb-a0a8-c873f365f88f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.503511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.504357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.504645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.504927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] PATH_INFO: `/v3/projects/5b3efca5f8ad404f814ab9c5b12ebcd2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.506197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3efca5f8ad404f814ab9c5b12ebcd2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.508226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.519615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66175cd0-320c-4265-9a31-7b0bd7161caf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.524717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae9df3-ac1a-4132-b291-b7dc5f377dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.525617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae9df3-ac1a-4132-b291-b7dc5f377dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.526089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae9df3-ac1a-4132-b291-b7dc5f377dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.526407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae9df3-ac1a-4132-b291-b7dc5f377dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.527104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae9df3-ac1a-4132-b291-b7dc5f377dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.529025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae9df3-ac1a-4132-b291-b7dc5f377dd9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.565389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3efca5f8ad404f814ab9c5b12ebcd2', 'request_id': 'req-78216d75-ec67-42c9-9efe-08f09691eb52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.571547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 921/1809] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:42.572454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3efca5f8ad404f814ab9c5b12ebcd2', 'request_id': 'req-78216d75-ec67-42c9-9efe-08f09691eb52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.572889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.573192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.573473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.581701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3efca5f8ad404f814ab9c5b12ebcd2', 'request_id': 'req-78216d75-ec67-42c9-9efe-08f09691eb52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.596631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] The token cache is being invalidate because project 5b3efca5f8ad404f814ab9c5b12ebcd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:42.596963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.597600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:42.598226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.599305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.602199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 889/1810] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:42 2022] DELETE /identity/v3/projects/5b3efca5f8ad404f814ab9c5b12ebcd2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:42.603098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.609070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.667416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 922/1811] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:42.668241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.669779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.674635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78216d75-ec67-42c9-9efe-08f09691eb52 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.679712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510141a8-418e-43e9-986f-38d402a7a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.680401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510141a8-418e-43e9-986f-38d402a7a308 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.680692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510141a8-418e-43e9-986f-38d402a7a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.680972 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510141a8-418e-43e9-986f-38d402a7a308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.681713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510141a8-418e-43e9-986f-38d402a7a308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.682352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1803dfb-a6aa-450e-a1fb-60d63b342365 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.683395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510141a8-418e-43e9-986f-38d402a7a308 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.687190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b921a-3ce2-4677-ae8e-eb21eb501a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.687904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b921a-3ce2-4677-ae8e-eb21eb501a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.688184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b921a-3ce2-4677-ae8e-eb21eb501a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.688495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b921a-3ce2-4677-ae8e-eb21eb501a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.689188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b921a-3ce2-4677-ae8e-eb21eb501a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.691152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b921a-3ce2-4677-ae8e-eb21eb501a51 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.693874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 890/1812] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:42.695207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec1f4-99a1-48ca-af69-12d80b2976df None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.695500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec1f4-99a1-48ca-af69-12d80b2976df None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.695779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec1f4-99a1-48ca-af69-12d80b2976df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.713534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 923/1813] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:42.715253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-04aec1f4-99a1-48ca-af69-12d80b2976df None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.716687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-04aec1f4-99a1-48ca-af69-12d80b2976df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.718148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ccbe-201d-4512-843d-75ac20d67084 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.718445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ccbe-201d-4512-843d-75ac20d67084 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.718814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ccbe-201d-4512-843d-75ac20d67084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.724682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 891/1814] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:42.725999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34120ca4-767d-4e5d-b9b3-a22c6908d79e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.726320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34120ca4-767d-4e5d-b9b3-a22c6908d79e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.726600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34120ca4-767d-4e5d-b9b3-a22c6908d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.738550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-73b5ccbe-201d-4512-843d-75ac20d67084 None None] MFA Rules not processed for user `f2217b3c134d453fbdcb14853eed4e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.739804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-73b5ccbe-201d-4512-843d-75ac20d67084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.745761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-34120ca4-767d-4e5d-b9b3-a22c6908d79e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.746956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-34120ca4-767d-4e5d-b9b3-a22c6908d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.755267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 892/1815] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:42.755949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34120ca4-767d-4e5d-b9b3-a22c6908d79e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.765286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34120ca4-767d-4e5d-b9b3-a22c6908d79e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.770049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.770975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.771518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.771518 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] PATH_INFO: `/v3/projects/88ab15bd437b46c5a72c4f69da037154/users/b3e5abc0dab44fb7bac004904e07f9c6/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.773474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ab15bd437b46c5a72c4f69da037154, user_id=b3e5abc0dab44fb7bac004904e07f9c6, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.776508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.781850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.788187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 893/1816] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:42 2022] PUT /identity/v3/projects/88ab15bd437b46c5a72c4f69da037154/users/b3e5abc0dab44fb7bac004904e07f9c6/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:42.789201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.809928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.812611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 924/1817] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:42.813967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe10b35-e37d-4f38-a46f-f5e5c1e9fcdd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.814289 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe10b35-e37d-4f38-a46f-f5e5c1e9fcdd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.814562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe10b35-e37d-4f38-a46f-f5e5c1e9fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.835344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ffe10b35-e37d-4f38-a46f-f5e5c1e9fcdd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.836849 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffe10b35-e37d-4f38-a46f-f5e5c1e9fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.882493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2376-74f6-45d5-822c-4f28da81600b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.887234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.887951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.888428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.889001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.889405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.891396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.902948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 894/1818] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:42.903870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.917889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e1d2-8484-4f13-bc38-7e3b5a5a3004 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.923960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.924650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.925001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.925285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.926156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:42.926480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.928143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.928592 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 925/1819] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:42.930029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79133c8-15b3-4187-ab5b-2b8d3ffed23a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.930490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79133c8-15b3-4187-ab5b-2b8d3ffed23a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.930652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79133c8-15b3-4187-ab5b-2b8d3ffed23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.945230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 895/1820] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:42.950799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.962509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031778a-9718-44f2-beeb-21edb8268e2d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.968346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.969298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.969638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c79133c8-15b3-4187-ab5b-2b8d3ffed23a None None] MFA Rules not processed for user `b3e5abc0dab44fb7bac004904e07f9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.969764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.970029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.970809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.971971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c79133c8-15b3-4187-ab5b-2b8d3ffed23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.972436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.995594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 896/1821] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:42.996955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.016557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b087-b46f-4db5-9f7a-525c138a978c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.028968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.030386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.030774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.031277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.032546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:43.032958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.036999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.058282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 897/1822] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:43.059183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.085132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 926/1823] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:43.086033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79133c8-15b3-4187-ab5b-2b8d3ffed23a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.098466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79133c8-15b3-4187-ab5b-2b8d3ffed23a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.100190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfec2a-ab59-4f46-87c1-5e46540b30a1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.107078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.109171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.109171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.109171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] PATH_INFO: `/v3/projects/13a309f6e9b44ce4a8f0d86c0170ebe8/users/f8979e3517c841a8ab9e75249449c61f/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.114085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.115105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.115595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.116186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.117072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.119235 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.127892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a309f6e9b44ce4a8f0d86c0170ebe8, user_id=f8979e3517c841a8ab9e75249449c61f, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.131807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.151636 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 927/1824] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:43 2022] PUT /identity/v3/projects/13a309f6e9b44ce4a8f0d86c0170ebe8/users/f8979e3517c841a8ab9e75249449c61f/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:43.152879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.157142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 898/1825] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:43 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:43.157142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.163609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:43.220327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.229714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6789b3f-20b0-4d80-9bf8-bad3045ddd57 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.235135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.235883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.236235 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.236605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.237869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e421e-0098-4b3f-9452-191dc6357778 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.317331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.325213 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c518d1-2639-4279-a13e-3eed28a98740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.326030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c518d1-2639-4279-a13e-3eed28a98740 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.326412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c518d1-2639-4279-a13e-3eed28a98740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.326764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c518d1-2639-4279-a13e-3eed28a98740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.327531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c518d1-2639-4279-a13e-3eed28a98740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.331626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c518d1-2639-4279-a13e-3eed28a98740 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.334083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.337054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.355948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 899/1826] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:43.356837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.370349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175850-d9cc-41ba-a0ae-9fdf5b7f3636 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.378389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 928/1827] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:43 2022] POST /identity/v3/projects => generated 409 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:43.379649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.380125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53d40-d59f-49b3-86ed-5d0a1e3b5ff0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.380572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53d40-d59f-49b3-86ed-5d0a1e3b5ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.380675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.380962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.381067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53d40-d59f-49b3-86ed-5d0a1e3b5ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.381477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.382314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.384449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.416504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0ba53d40-d59f-49b3-86ed-5d0a1e3b5ff0 None None] MFA Rules not processed for user `f8979e3517c841a8ab9e75249449c61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:43.417754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ba53d40-d59f-49b3-86ed-5d0a1e3b5ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:43.425865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 900/1828] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:43 2022] POST /identity/v3/users => generated 286 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:43.427254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.442710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bdaba-a8eb-46ef-9947-1915bd6056f8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.528619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 929/1829] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:43.530031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba53d40-d59f-49b3-86ed-5d0a1e3b5ff0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.541854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.542895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.543278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.549387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.549387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.549387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.559225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba53d40-d59f-49b3-86ed-5d0a1e3b5ff0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.571303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.572050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.572339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.573439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.574220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.576139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.591858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 930/1830] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:43.592680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.601827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 901/1831] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:43 2022] POST /identity/v3/users => generated 305 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:43.601827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.615134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213b23c-30ef-4db6-955b-cee282cb6f03 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.621601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.622334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.622620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.623084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.623769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.626557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.652995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 902/1832] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:43.652995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.664967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fcfee-4d34-430b-ba38-3a9811bd80e0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.669587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aff1c0-7125-4f62-ae64-2c53ef6456ea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.671239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.672144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.672527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.672900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.673949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.674994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.675971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.676096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.676302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.676584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.688566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.690491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.692336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 903/1833] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:43.693273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.699869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.705807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 931/1834] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:43.706941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.707556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704af4-0051-476a-b4f1-e97285e69612 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.716175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c0d05-bdaa-427b-9a64-02fdc3adf376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.717234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0d05-bdaa-427b-9a64-02fdc3adf376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.718864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0d05-bdaa-427b-9a64-02fdc3adf376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.719247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0d05-bdaa-427b-9a64-02fdc3adf376 admin admin] PATH_INFO: `/v3/projects/01da67a76fe74da69a11ac41f2beb7c2/users/b3ddac4144e9473fb7e235ba98c206fd/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.723899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20ef38-d3c1-4225-8457-0109f97074c8 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.730505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.731389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.731680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.731953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.733070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.734844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.747212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c0d05-bdaa-427b-9a64-02fdc3adf376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01da67a76fe74da69a11ac41f2beb7c2, user_id=b3ddac4144e9473fb7e235ba98c206fd, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.750392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c0d05-bdaa-427b-9a64-02fdc3adf376 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.765731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 932/1835] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:43.773745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.781400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 904/1836] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:43 2022] PUT /identity/v3/projects/01da67a76fe74da69a11ac41f2beb7c2/users/b3ddac4144e9473fb7e235ba98c206fd/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:43.786792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.787090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.787374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.797931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb834656-9b58-4b46-acb3-64aad93b1caa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.815188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:43.817275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:43.901307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eaac5-8ebe-45fc-8a6a-852a4e267ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.902826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eaac5-8ebe-45fc-8a6a-852a4e267ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.903275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eaac5-8ebe-45fc-8a6a-852a4e267ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.904148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eaac5-8ebe-45fc-8a6a-852a4e267ebb admin admin] PATH_INFO: `/v3/projects/8f30d8ad7a044ad6a2891e38e6892ffa/users/29a401df725d489cb584c4235875dfcb/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.930720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eaac5-8ebe-45fc-8a6a-852a4e267ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f30d8ad7a044ad6a2891e38e6892ffa, user_id=29a401df725d489cb584c4235875dfcb, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.934332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eaac5-8ebe-45fc-8a6a-852a4e267ebb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.954212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 905/1837] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:43.961757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.964330 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:43.966560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 933/1838] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:43 2022] PUT /identity/v3/projects/8f30d8ad7a044ad6a2891e38e6892ffa/users/29a401df725d489cb584c4235875dfcb/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:43.974682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed0147-fe54-4997-9329-15126d9a617b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.974984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed0147-fe54-4997-9329-15126d9a617b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.975474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed0147-fe54-4997-9329-15126d9a617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.991090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:44.011653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bbed0147-fe54-4997-9329-15126d9a617b None None] MFA Rules not processed for user `29a401df725d489cb584c4235875dfcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:44.013015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bbed0147-fe54-4997-9329-15126d9a617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:44.070428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfb32-3188-4d1e-a80b-eb04d60ee251 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.113931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 934/1839] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:44.118793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed0147-fe54-4997-9329-15126d9a617b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:44.148541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.149798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.152619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.153004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.265123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed0147-fe54-4997-9329-15126d9a617b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.271576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.272584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.272872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.273222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.273932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.276266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.283250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:44.284135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.285899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.313367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 906/1840] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:44.316888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 935/1841] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:44 2022] POST /identity/v3/projects => generated 409 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:02:44.321517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:44.332585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4e884-178f-4a2d-9b6c-e29cf9e7146f service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.426213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.427300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.428057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.428437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.430669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.433942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.470152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 907/1842] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:44 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:44.472784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:44.488818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429343-45de-4882-a838-badb0b25fddd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.498361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.499812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.500152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.500545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.501418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.503261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.515125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 936/1843] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:44.519223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:44.533772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fea07-b431-48d0-b2d7-a6fbd0ca671b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.539759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.540678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.541158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.541418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] PATH_INFO: `/v3/projects/44675884cd6040588ac1b6b7c94970b4/users/0003b2d1052c45b68bbb92f5f5bfd452/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.557749 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:44.563098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44675884cd6040588ac1b6b7c94970b4, user_id=0003b2d1052c45b68bbb92f5f5bfd452, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.566691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.587445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 908/1844] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:44 2022] PUT /identity/v3/projects/44675884cd6040588ac1b6b7c94970b4/users/0003b2d1052c45b68bbb92f5f5bfd452/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:44.591782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:44.605563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cdbdc-a017-4f51-8513-84ed083551d2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.697158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43988e-97a9-47e6-896b-765f17578081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.697921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43988e-97a9-47e6-896b-765f17578081 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.698446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43988e-97a9-47e6-896b-765f17578081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.698685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43988e-97a9-47e6-896b-765f17578081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.699286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43988e-97a9-47e6-896b-765f17578081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.701068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43988e-97a9-47e6-896b-765f17578081 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.733987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 937/1845] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:44.736142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:44.747583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b031d5-b824-4612-b407-06e9312df70b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.752659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.753716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.754027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.754482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] PATH_INFO: `/v3/projects/44675884cd6040588ac1b6b7c94970b4/users/0003b2d1052c45b68bbb92f5f5bfd452/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.756708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44675884cd6040588ac1b6b7c94970b4, user_id=0003b2d1052c45b68bbb92f5f5bfd452, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.759727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.781728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 909/1846] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:44 2022] PUT /identity/v3/projects/44675884cd6040588ac1b6b7c94970b4/users/0003b2d1052c45b68bbb92f5f5bfd452/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:44.783549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df8b6-c69f-4d47-b5fe-1df8f15a9587 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.783849 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df8b6-c69f-4d47-b5fe-1df8f15a9587 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.784133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df8b6-c69f-4d47-b5fe-1df8f15a9587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.867730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-558df8b6-c69f-4d47-b5fe-1df8f15a9587 None None] MFA Rules not processed for user `0003b2d1052c45b68bbb92f5f5bfd452`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:44.869040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-558df8b6-c69f-4d47-b5fe-1df8f15a9587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:44.960464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 938/1847] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:44.971935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.039979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7480873-1bfd-4934-bd44-c2d7cd0b27fb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.043493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.044193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.044479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.044770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.056406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.058027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.071044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 910/1848] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:45.209200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80451-c752-441a-b4ea-0499518275ba None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.210209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80451-c752-441a-b4ea-0499518275ba None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.210524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80451-c752-441a-b4ea-0499518275ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.249484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-98e80451-c752-441a-b4ea-0499518275ba None None] MFA Rules not processed for user `b3ddac4144e9473fb7e235ba98c206fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:45.250811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-98e80451-c752-441a-b4ea-0499518275ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:45.312282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:45.331468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.344880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959f8a2-006b-4c3e-83d8-da0b6253e969 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.350098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.355856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 939/1849] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:45.356048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.356048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.356048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.357967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80451-c752-441a-b4ea-0499518275ba None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.432219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.433853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.444410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 911/1850] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:45.449710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80451-c752-441a-b4ea-0499518275ba None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.455281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.456237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.456608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.456990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.457788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.459958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.495730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 940/1851] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:45 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:02:45.499459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.510196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.514354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dfc68-fc07-4adf-b188-334b3ec90d5b service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.585186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41212b83-66f8-4321-aa7c-21808cc8399f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.592973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.593879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.594335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.594735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] PATH_INFO: `/v3/users/275b6f21637d40ca83c8119d58932b25` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.596076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275b6f21637d40ca83c8119d58932b25)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.598997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.613379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.614136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.614548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.614833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.615537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.617479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.653239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 912/1852] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:45 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:45.659966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.675090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70131173-0735-45d4-8a7c-ed1d6df3c770 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.675412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275b6f21637d40ca83c8119d58932b25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:45.681926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.683001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.683353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.684082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.685047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.685672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275b6f21637d40ca83c8119d58932b25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:45.687402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.690034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:45.697150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275b6f21637d40ca83c8119d58932b25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:45.706431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 913/1853] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:45.709998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.713415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:45.720684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275b6f21637d40ca83c8119d58932b25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:45.721891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90aecd96-52ae-46ab-ab14-52c2209bfbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275b6f21637d40ca83c8119d58932b25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:45.728425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f95a1-7685-4cae-8a21-8da32b6626be admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.734456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 941/1854] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:45 2022] DELETE /identity/v3/users/275b6f21637d40ca83c8119d58932b25 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:45.735233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.736154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.736333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.736448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.736707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] PATH_INFO: `/v3/projects/ff1881be0a0d4706bc387e3494314c33/users/e190820da9ad41c5a1094f2da94ebd0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.739484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.739788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.758565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1881be0a0d4706bc387e3494314c33, user_id=e190820da9ad41c5a1094f2da94ebd0a, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.762390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.766498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:45.768137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:45.785662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 914/1855] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:45 2022] PUT /identity/v3/projects/ff1881be0a0d4706bc387e3494314c33/users/e190820da9ad41c5a1094f2da94ebd0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:45.789275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.791949 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:45.870083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 942/1856] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:45.881511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.883310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:45.888092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0a9e-0e41-4319-8250-233b0efd65f7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.892406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.893347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.893719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.894242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.895062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.896781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.910179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 915/1857] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:02:45.912991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:45.925620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73bb9-e561-49e2-94cb-c87f29853468 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:45.932776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:45.934145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:45.934260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:45.934583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] PATH_INFO: `/v3/projects/ff1881be0a0d4706bc387e3494314c33/users/e190820da9ad41c5a1094f2da94ebd0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:45.936997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1881be0a0d4706bc387e3494314c33, user_id=e190820da9ad41c5a1094f2da94ebd0a, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:45.940111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:45.956631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 916/1858] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:45 2022] PUT /identity/v3/projects/ff1881be0a0d4706bc387e3494314c33/users/e190820da9ad41c5a1094f2da94ebd0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:45.970673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b8a82-4eba-4610-a726-9b2e618aca88 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:46.031249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:46.031950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.032240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.034707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.099996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:46.101458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:46.105486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:46.113529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 943/1859] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:46.607824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:46.609913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:46.624708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b86fb-870e-4437-bc61-d2064d234a12 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:46.630326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:46.631359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.631638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.632059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] PATH_INFO: `/v3/projects/cf968796dff347c9bd0af2b4238be2dd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.633786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf968796dff347c9bd0af2b4238be2dd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:46.635920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:46.693449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf968796dff347c9bd0af2b4238be2dd', 'request_id': 'req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.700798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf968796dff347c9bd0af2b4238be2dd', 'request_id': 'req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.710179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf968796dff347c9bd0af2b4238be2dd', 'request_id': 'req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.722068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] The token cache is being invalidate because project cf968796dff347c9bd0af2b4238be2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:46.722509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.723175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-33d796b4-dd63-4e2c-9ba9-f3e10ff449ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.730455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 917/1860] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:46 2022] DELETE /identity/v3/projects/cf968796dff347c9bd0af2b4238be2dd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:46.734932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:46.745449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7255-2d43-4a93-a34d-2bbff13c92b7 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:46.751101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.751487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.752513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.783571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] MFA Rules not processed for user `e190820da9ad41c5a1094f2da94ebd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:46.785781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:46.811192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:46.812772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.813133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.813489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] PATH_INFO: `/v3/users/b3e5abc0dab44fb7bac004904e07f9c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.815252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e5abc0dab44fb7bac004904e07f9c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:46.817478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:46.821967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:46.893551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 918/1861] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:46.902719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e5abc0dab44fb7bac004904e07f9c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.908709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:46.910044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:46.920508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e5abc0dab44fb7bac004904e07f9c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.938419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e5abc0dab44fb7bac004904e07f9c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.965537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e5abc0dab44fb7bac004904e07f9c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.966469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e5abc0dab44fb7bac004904e07f9c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:46.975119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 944/1862] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:46 2022] DELETE /identity/v3/users/b3e5abc0dab44fb7bac004904e07f9c6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:47.003479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afba072-88ab-4bd5-b668-341f5f86133f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.064186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe995d0-0518-435e-9f91-ba4b4bc5d78f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.064912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe995d0-0518-435e-9f91-ba4b4bc5d78f service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.065253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe995d0-0518-435e-9f91-ba4b4bc5d78f service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.065542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe995d0-0518-435e-9f91-ba4b4bc5d78f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.067494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2fe995d0-0518-435e-9f91-ba4b4bc5d78f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:47.173345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe995d0-0518-435e-9f91-ba4b4bc5d78f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.175466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe995d0-0518-435e-9f91-ba4b4bc5d78f service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.196988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 919/1863] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:47.289311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.290877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:47.367365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a78bd-f5d9-42c9-b8ac-beb59d2d8197 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.373471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.374597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.375546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.375546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] PATH_INFO: `/v3/projects/88ab15bd437b46c5a72c4f69da037154` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.377278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ab15bd437b46c5a72c4f69da037154)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.379081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.404170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.431880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ab15bd437b46c5a72c4f69da037154', 'request_id': 'req-cc622782-71e7-4721-b704-5693483e620c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:47.439279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ab15bd437b46c5a72c4f69da037154', 'request_id': 'req-cc622782-71e7-4721-b704-5693483e620c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:47.447071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ab15bd437b46c5a72c4f69da037154', 'request_id': 'req-cc622782-71e7-4721-b704-5693483e620c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:47.457921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] The token cache is being invalidate because project 88ab15bd437b46c5a72c4f69da037154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:47.458244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:47.458916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc622782-71e7-4721-b704-5693483e620c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:47.460487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 945/1864] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:47 2022] DELETE /identity/v3/projects/88ab15bd437b46c5a72c4f69da037154 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:47.465709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3ab0-0509-4b4d-b76e-51fea6cd516c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.466195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3ab0-0509-4b4d-b76e-51fea6cd516c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.466425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3ab0-0509-4b4d-b76e-51fea6cd516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.492560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ca9a3ab0-0509-4b4d-b76e-51fea6cd516c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:47.493831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ca9a3ab0-0509-4b4d-b76e-51fea6cd516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:47.528759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.562234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 920/1865] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:47.571682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971124a-bf0d-4da2-93ef-03211af85666 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.571971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971124a-bf0d-4da2-93ef-03211af85666 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.572250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971124a-bf0d-4da2-93ef-03211af85666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.591401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b971124a-bf0d-4da2-93ef-03211af85666 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:47.592620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b971124a-bf0d-4da2-93ef-03211af85666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:47.600839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 946/1866] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:47.605060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3ab0-0509-4b4d-b76e-51fea6cd516c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.617540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3ab0-0509-4b4d-b76e-51fea6cd516c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.625106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.626188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.626602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.626988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.628141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:47.628492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.631085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.646838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 921/1867] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:47.651430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971124a-bf0d-4da2-93ef-03211af85666 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.662296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971124a-bf0d-4da2-93ef-03211af85666 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.669546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.670568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.670971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.671374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.672271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.674407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.703153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 947/1868] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:47.709271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.720405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b85e49-f863-4826-9a31-74ce8528d7b5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.780632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.781349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.781656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.781937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.782669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.784647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.805846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 922/1869] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:47.810217 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.821467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0cd9-daa7-4211-b355-c3eaa515b21b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.828118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.829134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.829568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.830126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.831350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.833942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.850211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 948/1870] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:47.855610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.867346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a45f-a97d-45aa-861c-72d22165c309 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.874715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618fb3d-ff4f-4fd3-abb3-095df8708961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.875795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618fb3d-ff4f-4fd3-abb3-095df8708961 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.876252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618fb3d-ff4f-4fd3-abb3-095df8708961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.876689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618fb3d-ff4f-4fd3-abb3-095df8708961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.877887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618fb3d-ff4f-4fd3-abb3-095df8708961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.880587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618fb3d-ff4f-4fd3-abb3-095df8708961 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.894029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 923/1871] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:47.898516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.909479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c72b7-a047-43e7-9dfc-73f65f368197 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.914769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.915826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.916114 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.916391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] PATH_INFO: `/v3/projects/7121d1e569e542e7a74837f5b5daf9a9/users/3f69543ef9b94309aeefc5d5e0bd5387/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.932199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7121d1e569e542e7a74837f5b5daf9a9, user_id=3f69543ef9b94309aeefc5d5e0bd5387, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.934927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.950482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 949/1872] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:47 2022] PUT /identity/v3/projects/7121d1e569e542e7a74837f5b5daf9a9/users/3f69543ef9b94309aeefc5d5e0bd5387/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:47.960894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64230b-cb28-479d-b63c-bdf9f8c15692 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.961189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64230b-cb28-479d-b63c-bdf9f8c15692 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.961470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64230b-cb28-479d-b63c-bdf9f8c15692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.992358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bd64230b-cb28-479d-b63c-bdf9f8c15692 None None] MFA Rules not processed for user `3f69543ef9b94309aeefc5d5e0bd5387`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:47.993726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bd64230b-cb28-479d-b63c-bdf9f8c15692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:48.063716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 924/1873] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:48.068487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.133875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17420f11-c89e-4d94-b484-1911652e233e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.138867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.139536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.139821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.140081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.142878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.144997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.174186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 950/1874] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:48 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:48.178506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64230b-cb28-479d-b63c-bdf9f8c15692 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.190407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64230b-cb28-479d-b63c-bdf9f8c15692 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.220607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:48.258441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.259169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.259387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.259662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.260371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.263024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.286998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 925/1875] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:48 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:48.288598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.299823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecd226-942f-4e1a-8597-8d3b44da2898 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.304631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.305311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.305600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.305881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.306648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.309562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.322170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 951/1876] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:48.324908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.336112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45130-d6b5-447a-b524-ffa8a1ef22e7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.342445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.343721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.344148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.344522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] PATH_INFO: `/v3/projects/c83499c0f2684d3fa8a54afc905f6638/users/47ad7f5a73494398b9d44e81b624eb0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.363385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83499c0f2684d3fa8a54afc905f6638, user_id=47ad7f5a73494398b9d44e81b624eb0a, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.366091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.381471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 926/1877] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:48 2022] PUT /identity/v3/projects/c83499c0f2684d3fa8a54afc905f6638/users/47ad7f5a73494398b9d44e81b624eb0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:48.386543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.397167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15624d1a-f8a8-40bd-9a96-7f69754b133a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.411185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:48.462516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57e16-44ec-420a-ac73-1fc5d6ab0461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.463201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57e16-44ec-420a-ac73-1fc5d6ab0461 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.463483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57e16-44ec-420a-ac73-1fc5d6ab0461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.463759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57e16-44ec-420a-ac73-1fc5d6ab0461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.464484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57e16-44ec-420a-ac73-1fc5d6ab0461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.466084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57e16-44ec-420a-ac73-1fc5d6ab0461 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.475860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 952/1878] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:48.480080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.491660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7394ab-8bd9-45c0-a646-83b35e6a8247 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.496484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.497380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.497663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.497958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] PATH_INFO: `/v3/projects/c83499c0f2684d3fa8a54afc905f6638/users/47ad7f5a73494398b9d44e81b624eb0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.499926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83499c0f2684d3fa8a54afc905f6638, user_id=47ad7f5a73494398b9d44e81b624eb0a, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.503278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.513723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 927/1879] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:48 2022] PUT /identity/v3/projects/c83499c0f2684d3fa8a54afc905f6638/users/47ad7f5a73494398b9d44e81b624eb0a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:48.525339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613ed5-0f91-4c80-b04a-cced082f1a6d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.525714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613ed5-0f91-4c80-b04a-cced082f1a6d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.526155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613ed5-0f91-4c80-b04a-cced082f1a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.558872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ed613ed5-0f91-4c80-b04a-cced082f1a6d None None] MFA Rules not processed for user `47ad7f5a73494398b9d44e81b624eb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:48.560107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed613ed5-0f91-4c80-b04a-cced082f1a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:48.649832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 953/1880] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:48.663983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.665898 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:48.724165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142e39-7326-4894-8aa6-d09c74f3ebb9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.728205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.728941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.729226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.729568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.741105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.742664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.764835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 928/1881] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:49.139872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613ed5-0f91-4c80-b04a-cced082f1a6d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:49.150225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613ed5-0f91-4c80-b04a-cced082f1a6d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:49.156508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47ad7f5a73494398b9d44e81b624eb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c83499c0f2684d3fa8a54afc905f6638', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:49.158047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:49.158704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:49.159259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:49.160279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:49.161868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:49.162729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:49.182283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 954/1882] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:49.186772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:49.202427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7ac3-9626-4899-a06a-d2a9de82d089 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:49.216663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47ad7f5a73494398b9d44e81b624eb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c83499c0f2684d3fa8a54afc905f6638', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:49.217486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:49.223519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:49.223851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:49.224621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:49.227299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:49.288713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 929/1883] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:49 2022] POST /identity/v3/projects => generated 354 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:49.292794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:49.303865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c8ebb-e8a1-4b76-8965-c5190c4e6b5b tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:49.386998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:49.400464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47ad7f5a73494398b9d44e81b624eb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c83499c0f2684d3fa8a54afc905f6638', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:49.401263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:49.401557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:49.401839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:49.402865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:49.403184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:49.404820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:49.422819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 955/1884] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:49.464081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbca9-58a0-4acf-9355-34ecd59ea1be tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:49.468663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399038-4f1b-4555-8738-6a89a8cd83b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:49.470069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399038-4f1b-4555-8738-6a89a8cd83b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:49.470406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399038-4f1b-4555-8738-6a89a8cd83b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:49.470882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399038-4f1b-4555-8738-6a89a8cd83b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:49.473359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8c399038-4f1b-4555-8738-6a89a8cd83b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:49.474615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:49.490851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4441-8dfa-4077-89f5-c75ba47b1910 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:49.503038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47ad7f5a73494398b9d44e81b624eb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c83499c0f2684d3fa8a54afc905f6638', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:49.504000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:49.504296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:49.506615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] PATH_INFO: `/v3/projects/460b853c06294103ba83558cf74715a5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:49.506795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=460b853c06294103ba83558cf74715a5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:49.521226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:49.560956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:49.564745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:49.644779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460b853c06294103ba83558cf74715a5', 'request_id': 'req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:49.665167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460b853c06294103ba83558cf74715a5', 'request_id': 'req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:49.683786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460b853c06294103ba83558cf74715a5', 'request_id': 'req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:49.697967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] The token cache is being invalidate because project 460b853c06294103ba83558cf74715a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:49.698329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:49.699053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:49.700074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399038-4f1b-4555-8738-6a89a8cd83b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:49.700789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 956/1885] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:49 2022] DELETE /identity/v3/projects/460b853c06294103ba83558cf74715a5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:49.702561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399038-4f1b-4555-8738-6a89a8cd83b4 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:49.735477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 930/1886] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:50.084002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:50.086502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:50.166732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6cf73-d619-4cc5-97f6-0a68e4bc15f0 tempest-VolumeQuotaClassesTest-646125943 tempest-VolumeQuotaClassesTest-646125943-project-admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:50.172596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:50.173634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:50.174090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:50.174398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] PATH_INFO: `/v3/users/3f69543ef9b94309aeefc5d5e0bd5387` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:50.177034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f69543ef9b94309aeefc5d5e0bd5387)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:50.181342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:50.263528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f69543ef9b94309aeefc5d5e0bd5387'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:50.273088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f69543ef9b94309aeefc5d5e0bd5387'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:50.283181 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f69543ef9b94309aeefc5d5e0bd5387'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:50.307772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f69543ef9b94309aeefc5d5e0bd5387'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:50.308825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f69543ef9b94309aeefc5d5e0bd5387'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:50.320759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 957/1887] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:50 2022] DELETE /identity/v3/users/3f69543ef9b94309aeefc5d5e0bd5387 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:50.326973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:50.327895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:50.328243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:50.347990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:50.350165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:50.424052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 931/1888] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:50.437154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:50.439068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:50.472050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:50.514036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e53fcb-dda2-4889-8aff-688a11d72a70 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:50.520248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:50.522354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:50.522354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:50.522354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:50.536934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:50.539586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:50.555566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 958/1889] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:51.077540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.086143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:51.124271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d76a-4d38-4b3d-a276-2be834cb69a6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.136616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.137535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.137828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.138145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] PATH_INFO: `/v3/projects/7121d1e569e542e7a74837f5b5daf9a9` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.139725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7121d1e569e542e7a74837f5b5daf9a9)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.141745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.220852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7121d1e569e542e7a74837f5b5daf9a9', 'request_id': 'req-be28f69a-092a-4297-9756-abede3c66a98'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.231233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7121d1e569e542e7a74837f5b5daf9a9', 'request_id': 'req-be28f69a-092a-4297-9756-abede3c66a98'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.251343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7121d1e569e542e7a74837f5b5daf9a9', 'request_id': 'req-be28f69a-092a-4297-9756-abede3c66a98'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.275228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] The token cache is being invalidate because project 7121d1e569e542e7a74837f5b5daf9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:51.275574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.276295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.280337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 932/1890] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:51 2022] DELETE /identity/v3/projects/7121d1e569e542e7a74837f5b5daf9a9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:51.284129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.298288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708160-2449-4026-8b25-3382cf601ae3 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.371015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.371994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.372546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.372893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] PATH_INFO: `/v3/users/47ad7f5a73494398b9d44e81b624eb0a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.374207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ad7f5a73494398b9d44e81b624eb0a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.376234 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.439897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ad7f5a73494398b9d44e81b624eb0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.447640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ad7f5a73494398b9d44e81b624eb0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.455421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ad7f5a73494398b9d44e81b624eb0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.467558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ad7f5a73494398b9d44e81b624eb0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.468210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ad7f5a73494398b9d44e81b624eb0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.475090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 959/1891] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:02:51 2022] DELETE /identity/v3/users/47ad7f5a73494398b9d44e81b624eb0a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:51.778432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.779914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:51.793677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28f69a-092a-4297-9756-abede3c66a98 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.835960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.865483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.867766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:51.870266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.871112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.871394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.871672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] PATH_INFO: `/v3/projects/c83499c0f2684d3fa8a54afc905f6638` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.872887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83499c0f2684d3fa8a54afc905f6638)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.875236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.933491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.943010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83499c0f2684d3fa8a54afc905f6638', 'request_id': 'req-aaa94173-7e32-4fa3-9f46-95f997338d1f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.945430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6c78-dc51-49bb-898a-45fd12e183e9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.949948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83499c0f2684d3fa8a54afc905f6638', 'request_id': 'req-aaa94173-7e32-4fa3-9f46-95f997338d1f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.959010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83499c0f2684d3fa8a54afc905f6638', 'request_id': 'req-aaa94173-7e32-4fa3-9f46-95f997338d1f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.969685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] The token cache is being invalidate because project c83499c0f2684d3fa8a54afc905f6638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:02:51.969977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.970633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aaa94173-7e32-4fa3-9f46-95f997338d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:02:51.972195 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 933/1892] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:02:51 2022] DELETE /identity/v3/projects/c83499c0f2684d3fa8a54afc905f6638 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:51.977246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069a1c-beee-45e1-a499-cf16f15879c2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.977602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069a1c-beee-45e1-a499-cf16f15879c2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.977966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069a1c-beee-45e1-a499-cf16f15879c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.995746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-74069a1c-beee-45e1-a499-cf16f15879c2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:51.996098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.996762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.996952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-74069a1c-beee-45e1-a499-cf16f15879c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:51.997056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.997339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.999265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:52.057810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 934/1893] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:52.063438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.065055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.066485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6b65d-28cd-4925-b5fb-ec25a1c1a2f6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.066892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6b65d-28cd-4925-b5fb-ec25a1c1a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.067192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6b65d-28cd-4925-b5fb-ec25a1c1a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.075016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 960/1894] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:52.086020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-35e6b65d-28cd-4925-b5fb-ec25a1c1a2f6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:52.087302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-35e6b65d-28cd-4925-b5fb-ec25a1c1a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:52.096741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 935/1895] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:52.101056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.112457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d4654-248b-4f7b-8a23-e97a057c53fe service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.117737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.118387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.118674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.118952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.119681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:52.119992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.121645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.137164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 961/1896] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:52.138421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6b65d-28cd-4925-b5fb-ec25a1c1a2f6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.148220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6b65d-28cd-4925-b5fb-ec25a1c1a2f6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.153983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.154789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.155080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.155358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.156063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.158032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.191086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 936/1897] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:52.195255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.205351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbebfc-1505-4430-a87d-24269fbddfca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.274268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.275336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.275693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.275978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.276688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.278775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.307690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 962/1898] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:52.311987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.324409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63c9f7-cf1a-404c-b341-7cbdbd8cd099 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.363412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.364112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.364401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.364679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.365419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.367184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.382149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 937/1899] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:52.386167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.396575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7cca-7214-4469-9963-ae6c4c593954 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.401709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b588b-17b1-4f9d-bd45-3df22439bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.402422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b588b-17b1-4f9d-bd45-3df22439bf1d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.402712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b588b-17b1-4f9d-bd45-3df22439bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.403338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b588b-17b1-4f9d-bd45-3df22439bf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.403725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b588b-17b1-4f9d-bd45-3df22439bf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.405330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b588b-17b1-4f9d-bd45-3df22439bf1d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.417612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 963/1900] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:52.421359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.431767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38f4af-27f0-4059-b4fb-9b58e8c43460 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.436547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.437555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.437991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.438633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] PATH_INFO: `/v3/projects/f09806f1b7cd4b2ea8cd793c9538b2f0/users/03626d74001c4c098686c699c36d72e0/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.457312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09806f1b7cd4b2ea8cd793c9538b2f0, user_id=03626d74001c4c098686c699c36d72e0, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.460199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.476580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 938/1901] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:52 2022] PUT /identity/v3/projects/f09806f1b7cd4b2ea8cd793c9538b2f0/users/03626d74001c4c098686c699c36d72e0/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:52.487502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d05cc-e235-42c5-921c-e3da791b673c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.487797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d05cc-e235-42c5-921c-e3da791b673c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.488086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d05cc-e235-42c5-921c-e3da791b673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.515704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f50d05cc-e235-42c5-921c-e3da791b673c None None] MFA Rules not processed for user `03626d74001c4c098686c699c36d72e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:52.517110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f50d05cc-e235-42c5-921c-e3da791b673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:52.521466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.594383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 964/1902] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:52.599502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.604429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.668482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7878-b2a8-4c5a-9f68-2f6006a1ebe7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.674357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a292c1-dca9-478b-b412-702b55ca318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.675040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a292c1-dca9-478b-b412-702b55ca318e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.675330 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a292c1-dca9-478b-b412-702b55ca318e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.675610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a292c1-dca9-478b-b412-702b55ca318e admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.676331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a292c1-dca9-478b-b412-702b55ca318e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.678295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a292c1-dca9-478b-b412-702b55ca318e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.707265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 939/1903] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:02:52.711461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d05cc-e235-42c5-921c-e3da791b673c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.723053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d05cc-e235-42c5-921c-e3da791b673c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.782376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.783060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.783350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.783627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.784319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.786280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.795446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386154f-89ac-440d-bde3-e898ae359ff8 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.795922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386154f-89ac-440d-bde3-e898ae359ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.796227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386154f-89ac-440d-bde3-e898ae359ff8 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.797672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 940/1904] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:52.809639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.810016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.810433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.813712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 965/1905] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:52.818246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.829930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4247-226d-4cb2-b70c-f479e30fce6b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.835134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.835817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.836227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.836509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.837351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.838127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:52.839038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.839391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:52.851678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 966/1906] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:52.856046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.867803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0cdf6-786d-495c-be83-2fe51a9a1e3b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.873269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.874220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.874509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.874789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.875846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.877466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.888661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 967/1907] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:02:52.892870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.902888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740787a7-429c-40b0-adea-7be86d884cb1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.907902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7ef31-92c4-42c2-98b9-5dcde26090ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.908800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ef31-92c4-42c2-98b9-5dcde26090ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.909088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ef31-92c4-42c2-98b9-5dcde26090ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.909368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ef31-92c4-42c2-98b9-5dcde26090ab admin admin] PATH_INFO: `/v3/projects/5303908283c24067aa4894a3cce9d600/users/f10ec52b1a3648038628ab57bda99b53/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.918336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 941/1908] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:52.927109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7ef31-92c4-42c2-98b9-5dcde26090ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5303908283c24067aa4894a3cce9d600, user_id=f10ec52b1a3648038628ab57bda99b53, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.929803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7ef31-92c4-42c2-98b9-5dcde26090ab admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.935885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.937612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:52.947948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 968/1909] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:52 2022] PUT /identity/v3/projects/5303908283c24067aa4894a3cce9d600/users/f10ec52b1a3648038628ab57bda99b53/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:52.958182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1704b1-ab96-4f80-b252-a2c0447c5e1a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.958742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1704b1-ab96-4f80-b252-a2c0447c5e1a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.959090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1704b1-ab96-4f80-b252-a2c0447c5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.960261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9369e3-bbac-496c-8200-06857ec6b21f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.994309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5e1704b1-ab96-4f80-b252-a2c0447c5e1a None None] MFA Rules not processed for user `f10ec52b1a3648038628ab57bda99b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:52.995706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5e1704b1-ab96-4f80-b252-a2c0447c5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:53.038318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.049690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.050493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.050846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.051247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.062363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.064020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.065673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 969/1910] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:02:53.070931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1704b1-ab96-4f80-b252-a2c0447c5e1a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.075639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 942/1911] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:02:53.139395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1704b1-ab96-4f80-b252-a2c0447c5e1a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.144090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.144759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.145045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.145326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.146017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.147988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.176000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 970/1912] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:02:53 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:02:53.180188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.186554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.191069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab038e-3c56-4954-871e-77c9fdc2b0da service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.252326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.253023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.253308 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.253582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.254316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.256285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.280711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 943/1913] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:02:53 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:53.285839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.303268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cce825-011c-4fd1-8f5c-ed1ce65ba7a1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.311941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.312824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.313156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.313459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.314235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.315880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.328762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 971/1914] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:53.335327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.347079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f959def-522e-4d9f-a676-255d5d10c4ba admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.352411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.353671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.353844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.354161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] PATH_INFO: `/v3/projects/0f9357642e4a45f095bb7d2bcaad477c/users/283d7689b907492d9ac97ee1c7960035/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.371054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9357642e4a45f095bb7d2bcaad477c, user_id=283d7689b907492d9ac97ee1c7960035, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.373756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.388640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 944/1915] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:53 2022] PUT /identity/v3/projects/0f9357642e4a45f095bb7d2bcaad477c/users/283d7689b907492d9ac97ee1c7960035/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:53.392713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.403860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e9049-7daa-485a-b800-277c4df4cd21 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.464618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c466185-2cde-4c97-abff-50f1ea07d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.465309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466185-2cde-4c97-abff-50f1ea07d833 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.465597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466185-2cde-4c97-abff-50f1ea07d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.465876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466185-2cde-4c97-abff-50f1ea07d833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.466652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c466185-2cde-4c97-abff-50f1ea07d833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.468269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c466185-2cde-4c97-abff-50f1ea07d833 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.480146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 972/1916] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:02:53.484545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.496227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a078-d403-4fa0-80db-ad80e1a6445c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.505039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.505952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.506268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.506541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] PATH_INFO: `/v3/projects/0f9357642e4a45f095bb7d2bcaad477c/users/283d7689b907492d9ac97ee1c7960035/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.508746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9357642e4a45f095bb7d2bcaad477c, user_id=283d7689b907492d9ac97ee1c7960035, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.511499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.522716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 945/1917] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:02:53 2022] PUT /identity/v3/projects/0f9357642e4a45f095bb7d2bcaad477c/users/283d7689b907492d9ac97ee1c7960035/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:53.534315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.534621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.534893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.568753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] MFA Rules not processed for user `283d7689b907492d9ac97ee1c7960035`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:53.569947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:53.610467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.641585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 973/1918] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:02:53.654227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.657157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:53.715683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5f83-dce3-4010-8410-7d8143b76fb8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.719432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.720084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.720364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.720637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.730020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.731551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.741665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 946/1919] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:02:53.782793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.784451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:53.797809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e4fc-4574-4f81-bbfb-edc03502c93b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.802449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda58b-50f1-4557-8299-646f7a584de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.803092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda58b-50f1-4557-8299-646f7a584de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.803372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda58b-50f1-4557-8299-646f7a584de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.803649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda58b-50f1-4557-8299-646f7a584de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.865817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda58b-50f1-4557-8299-646f7a584de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.867332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda58b-50f1-4557-8299-646f7a584de5 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.876743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 974/1920] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:01.558565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.561028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:01.687858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e108451-c16b-4742-8ab4-27f2400f822f service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.699094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.702529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.703773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.704057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] PATH_INFO: `/v3/users/f8979e3517c841a8ab9e75249449c61f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.706831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8979e3517c841a8ab9e75249449c61f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.711304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.716739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.819685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8979e3517c841a8ab9e75249449c61f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:01.830621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8979e3517c841a8ab9e75249449c61f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:01.844717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8979e3517c841a8ab9e75249449c61f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:01.862910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8979e3517c841a8ab9e75249449c61f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:01.863772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8979e3517c841a8ab9e75249449c61f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:01.871720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 947/1921] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:01 2022] DELETE /identity/v3/users/f8979e3517c841a8ab9e75249449c61f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:01.876390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.877591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.878293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.899963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:01.901488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:01.962481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 975/1922] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:01.976072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.977585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:02.039219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12416e9-ae8d-4f73-b408-e8e2cb35f892 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.043313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197ba33-d861-45ba-b2f1-62f0a96e23f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.043983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197ba33-d861-45ba-b2f1-62f0a96e23f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.044267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197ba33-d861-45ba-b2f1-62f0a96e23f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.044555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197ba33-d861-45ba-b2f1-62f0a96e23f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.054446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197ba33-d861-45ba-b2f1-62f0a96e23f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.055893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197ba33-d861-45ba-b2f1-62f0a96e23f3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.066785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 948/1923] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:02.840112 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.841923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:02.860182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7adfe-0751-4b6b-a92c-f1ada509aca2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.870301 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.871299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.871655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.871938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] PATH_INFO: `/v3/projects/13a309f6e9b44ce4a8f0d86c0170ebe8` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.873176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a309f6e9b44ce4a8f0d86c0170ebe8)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.875304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.925878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a309f6e9b44ce4a8f0d86c0170ebe8', 'request_id': 'req-3b358264-0dea-42d5-9eb8-7616f3deddf7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:02.932483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a309f6e9b44ce4a8f0d86c0170ebe8', 'request_id': 'req-3b358264-0dea-42d5-9eb8-7616f3deddf7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:02.941790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a309f6e9b44ce4a8f0d86c0170ebe8', 'request_id': 'req-3b358264-0dea-42d5-9eb8-7616f3deddf7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:02.946733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.953473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] The token cache is being invalidate because project 13a309f6e9b44ce4a8f0d86c0170ebe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:02.953776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:02.954900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b358264-0dea-42d5-9eb8-7616f3deddf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:02.956869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 976/1924] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:02 2022] DELETE /identity/v3/projects/13a309f6e9b44ce4a8f0d86c0170ebe8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:02.961666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf701-ca90-47c6-9779-b3d297827a16 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.962226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf701-ca90-47c6-9779-b3d297827a16 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.962437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf701-ca90-47c6-9779-b3d297827a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.982047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f9faf701-ca90-47c6-9779-b3d297827a16 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:02.983748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f9faf701-ca90-47c6-9779-b3d297827a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:03.049733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 949/1925] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:03.058129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3941-a98b-415c-b6c7-eaee159467f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.058450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3941-a98b-415c-b6c7-eaee159467f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.058732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3941-a98b-415c-b6c7-eaee159467f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.079067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ddae3941-a98b-415c-b6c7-eaee159467f6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:03.080285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ddae3941-a98b-415c-b6c7-eaee159467f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:03.089663 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 977/1926] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:03.093981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf701-ca90-47c6-9779-b3d297827a16 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.104561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf701-ca90-47c6-9779-b3d297827a16 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.110447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.111110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.111395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.111678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.112536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:03.112854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.114522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.126963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 950/1927] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:03.131133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3941-a98b-415c-b6c7-eaee159467f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.140752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3941-a98b-415c-b6c7-eaee159467f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.146355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.146927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.147212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.147488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.148176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.150075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.178723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 978/1928] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:03 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:03.183677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.199159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c95ff-19e0-4bf7-b30c-6bb14eb1ce6f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.207242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:03.265048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.265787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.266078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.266398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.267098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.269658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.292699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 951/1929] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:03 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:03.297443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.308654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e5a90-ef2f-4729-9c61-e210830835b7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.313430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.314099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.314411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.314683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.315474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.317073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.327357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 979/1930] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:03.331845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.344006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf835-1f6a-4d8d-90f3-9b470a8162df admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.350356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58171317-b218-411b-935b-f9088a4a5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.351010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58171317-b218-411b-935b-f9088a4a5542 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.351294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58171317-b218-411b-935b-f9088a4a5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.351571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58171317-b218-411b-935b-f9088a4a5542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.352294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58171317-b218-411b-935b-f9088a4a5542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.353931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58171317-b218-411b-935b-f9088a4a5542 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.364557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 952/1931] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:03.368754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.379186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfc0db-6f1a-4a8e-a599-91012a4154d6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.384326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.385233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.385543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.385820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] PATH_INFO: `/v3/projects/a80d6467cb1844f0a226059c5d1964df/users/7339b3922533478caa4322aed754b09a/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.402330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80d6467cb1844f0a226059c5d1964df, user_id=7339b3922533478caa4322aed754b09a, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.404820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.422130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 980/1932] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:03 2022] PUT /identity/v3/projects/a80d6467cb1844f0a226059c5d1964df/users/7339b3922533478caa4322aed754b09a/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:03.433667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.433963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.434282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.462318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] MFA Rules not processed for user `7339b3922533478caa4322aed754b09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:03.463557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:03.547679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 953/1933] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:03.555393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.557236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:03.617745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b5de5-09e3-474c-a3d1-75d012405358 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.621340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918780-b37c-4257-88a6-85dcb6ee5694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.622000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918780-b37c-4257-88a6-85dcb6ee5694 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.622317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918780-b37c-4257-88a6-85dcb6ee5694 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.622597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918780-b37c-4257-88a6-85dcb6ee5694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.632173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918780-b37c-4257-88a6-85dcb6ee5694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.633624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918780-b37c-4257-88a6-85dcb6ee5694 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.642917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 981/1934] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:08.037333 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.038838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:08.108824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e30c1a-4d31-4e30-b852-f90c1aae1050 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.121860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.121860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.121860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.121860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] PATH_INFO: `/v3/users/03626d74001c4c098686c699c36d72e0` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.122312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03626d74001c4c098686c699c36d72e0)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.122312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.145813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.173950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03626d74001c4c098686c699c36d72e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:08.189177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03626d74001c4c098686c699c36d72e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:08.200913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03626d74001c4c098686c699c36d72e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:08.219400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03626d74001c4c098686c699c36d72e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:08.220070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03626d74001c4c098686c699c36d72e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:08.236919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 954/1935] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:08 2022] DELETE /identity/v3/users/03626d74001c4c098686c699c36d72e0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:08.239219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.240127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.240567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.263545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:08.265192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:08.349319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 982/1936] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:08.361040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.362873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:08.448212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be765e-0da2-4ad7-9707-2febec39c053 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.454965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.458656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.459245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.459745 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.484499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.489948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.515139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 955/1937] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:03:09.117405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.119028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:09.136558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c546835-5d6f-46f6-9725-b301716f4272 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.145335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.146588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.147102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.147556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] PATH_INFO: `/v3/projects/f09806f1b7cd4b2ea8cd793c9538b2f0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.149757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09806f1b7cd4b2ea8cd793c9538b2f0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.152886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.203394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.225906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09806f1b7cd4b2ea8cd793c9538b2f0', 'request_id': 'req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.235955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09806f1b7cd4b2ea8cd793c9538b2f0', 'request_id': 'req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.255322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09806f1b7cd4b2ea8cd793c9538b2f0', 'request_id': 'req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.288995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] The token cache is being invalidate because project f09806f1b7cd4b2ea8cd793c9538b2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:09.289569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.291474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.297314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 983/1938] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:09 2022] DELETE /identity/v3/projects/f09806f1b7cd4b2ea8cd793c9538b2f0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:09.298233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.311860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc592-5006-4fb0-bc46-d447585be651 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.377704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.380347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:09.389807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.390824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.391171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.391505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] PATH_INFO: `/v3/users/f10ec52b1a3648038628ab57bda99b53` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.393094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10ec52b1a3648038628ab57bda99b53)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.395515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.440878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.446435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10ec52b1a3648038628ab57bda99b53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.448354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8824-9d1a-46aa-b5ec-6aa94f2260d8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.453653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.454667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.454842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10ec52b1a3648038628ab57bda99b53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.454943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.455210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] PATH_INFO: `/v3/users/29a401df725d489cb584c4235875dfcb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.456384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a401df725d489cb584c4235875dfcb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.458415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.464057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10ec52b1a3648038628ab57bda99b53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.478663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10ec52b1a3648038628ab57bda99b53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.479381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-30edae75-44fb-4d74-bc3a-a4de471ed034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10ec52b1a3648038628ab57bda99b53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.485985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 956/1939] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:09 2022] DELETE /identity/v3/users/f10ec52b1a3648038628ab57bda99b53 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:09.507237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a401df725d489cb584c4235875dfcb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.515913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a401df725d489cb584c4235875dfcb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.525868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a401df725d489cb584c4235875dfcb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.541710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a401df725d489cb584c4235875dfcb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.542681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a401df725d489cb584c4235875dfcb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.550065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 984/1940] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:09 2022] DELETE /identity/v3/users/29a401df725d489cb584c4235875dfcb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:09.556016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6912-6703-4410-957b-3319db45f906 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.556622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6912-6703-4410-957b-3319db45f906 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.556896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6912-6703-4410-957b-3319db45f906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.576425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4abf6912-6703-4410-957b-3319db45f906 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:09.577686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4abf6912-6703-4410-957b-3319db45f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:09.647552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 957/1941] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:09.657256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.658973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:09.734582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.757432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13466-d85b-40e3-bb30-7eb46f36d7ea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.761192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.762170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.770290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.773239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.784128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.786332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.803542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 985/1942] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:09.821218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf6912-6703-4410-957b-3319db45f906 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.823992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4abf6912-6703-4410-957b-3319db45f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:09.839812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf6912-6703-4410-957b-3319db45f906 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.845059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.846941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.847230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.847510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] PATH_INFO: `/v3/projects/5303908283c24067aa4894a3cce9d600` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.849002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5303908283c24067aa4894a3cce9d600)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.851444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.951011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5303908283c24067aa4894a3cce9d600', 'request_id': 'req-cb48e475-7d64-4566-b7bb-a5ef97e82938'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.959007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5303908283c24067aa4894a3cce9d600', 'request_id': 'req-cb48e475-7d64-4566-b7bb-a5ef97e82938'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.974616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5303908283c24067aa4894a3cce9d600', 'request_id': 'req-cb48e475-7d64-4566-b7bb-a5ef97e82938'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.992388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] The token cache is being invalidate because project 5303908283c24067aa4894a3cce9d600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:09.992682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.993357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:09.997838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 958/1943] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:09 2022] DELETE /identity/v3/projects/5303908283c24067aa4894a3cce9d600 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:09.999587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.014996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d428f-6326-403c-af78-1db5696c4c89 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.109391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.110319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.110609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.110888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] PATH_INFO: `/v3/users/283d7689b907492d9ac97ee1c7960035` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.112226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283d7689b907492d9ac97ee1c7960035)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.114249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.172805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283d7689b907492d9ac97ee1c7960035'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.196721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.198233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:10.214004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283d7689b907492d9ac97ee1c7960035'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.221470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48e475-7d64-4566-b7bb-a5ef97e82938 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.226688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283d7689b907492d9ac97ee1c7960035'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.227294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.228293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.228677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.229096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] PATH_INFO: `/v3/projects/8f30d8ad7a044ad6a2891e38e6892ffa` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.230651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f30d8ad7a044ad6a2891e38e6892ffa)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.233690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.245425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283d7689b907492d9ac97ee1c7960035'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.246753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283d7689b907492d9ac97ee1c7960035'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.254163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 986/1944] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:09 2022] DELETE /identity/v3/users/283d7689b907492d9ac97ee1c7960035 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:10.280826 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.294703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f30d8ad7a044ad6a2891e38e6892ffa', 'request_id': 'req-e22f2e65-31d2-4c2f-86f4-8f531473c97a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.302577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f30d8ad7a044ad6a2891e38e6892ffa', 'request_id': 'req-e22f2e65-31d2-4c2f-86f4-8f531473c97a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.315212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f30d8ad7a044ad6a2891e38e6892ffa', 'request_id': 'req-e22f2e65-31d2-4c2f-86f4-8f531473c97a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.326847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] The token cache is being invalidate because project 8f30d8ad7a044ad6a2891e38e6892ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:10.327136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.327848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.329429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 959/1945] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:10 2022] DELETE /identity/v3/projects/8f30d8ad7a044ad6a2891e38e6892ffa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:10.333811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.335516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:10.407667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2fdc-c115-4ec1-a145-c769d66f36d1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.412098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.469696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.470650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.470925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.471197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] PATH_INFO: `/v3/users/0003b2d1052c45b68bbb92f5f5bfd452` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.472408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0003b2d1052c45b68bbb92f5f5bfd452)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.474377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.534159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0003b2d1052c45b68bbb92f5f5bfd452'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.538816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0003b2d1052c45b68bbb92f5f5bfd452'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.548346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0003b2d1052c45b68bbb92f5f5bfd452'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.561532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0003b2d1052c45b68bbb92f5f5bfd452'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.562227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40c71003-ff14-4f1c-82a2-09adecff4db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0003b2d1052c45b68bbb92f5f5bfd452'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.569345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 987/1946] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:10 2022] DELETE /identity/v3/users/0003b2d1052c45b68bbb92f5f5bfd452 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:10.630983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.636385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:10.651937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f2e65-31d2-4c2f-86f4-8f531473c97a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.717481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.718406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.718692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.719252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] PATH_INFO: `/v3/projects/0f9357642e4a45f095bb7d2bcaad477c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.720940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9357642e4a45f095bb7d2bcaad477c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.722791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.785534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9357642e4a45f095bb7d2bcaad477c', 'request_id': 'req-ebadd39a-7d40-4170-a134-f888fcf6ba3f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.795761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9357642e4a45f095bb7d2bcaad477c', 'request_id': 'req-ebadd39a-7d40-4170-a134-f888fcf6ba3f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.804969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9357642e4a45f095bb7d2bcaad477c', 'request_id': 'req-ebadd39a-7d40-4170-a134-f888fcf6ba3f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.816755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] The token cache is being invalidate because project 0f9357642e4a45f095bb7d2bcaad477c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:10.817236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.818079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:10.819927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 960/1947] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:10 2022] DELETE /identity/v3/projects/0f9357642e4a45f095bb7d2bcaad477c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:10.825802 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c38f-2d94-4333-afac-6d00721dfcaa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.826094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c38f-2d94-4333-afac-6d00721dfcaa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.826408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c38f-2d94-4333-afac-6d00721dfcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.853345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c6d1c38f-2d94-4333-afac-6d00721dfcaa None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:10.854645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c6d1c38f-2d94-4333-afac-6d00721dfcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:10.875409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.877610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:10.946153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 988/1948] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:10.951248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137404-e2b2-4ae3-813e-7f1fa61b67fd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.951702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137404-e2b2-4ae3-813e-7f1fa61b67fd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.952912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137404-e2b2-4ae3-813e-7f1fa61b67fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.977982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.984023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd39a-7d40-4170-a134-f888fcf6ba3f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.984931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-69137404-e2b2-4ae3-813e-7f1fa61b67fd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:10.986382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69137404-e2b2-4ae3-813e-7f1fa61b67fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:10.995339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.995626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 989/1949] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:10.996772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.997210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.997642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] PATH_INFO: `/v3/projects/44675884cd6040588ac1b6b7c94970b4` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.998974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=44675884cd6040588ac1b6b7c94970b4)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.000632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69137404-e2b2-4ae3-813e-7f1fa61b67fd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.001063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.012501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69137404-e2b2-4ae3-813e-7f1fa61b67fd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.018816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.019782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.020219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.020658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.021736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:11.022214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.023986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.037856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 990/1950] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:11.043093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.053155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc6cc-e892-4925-a50e-c663fd88284f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.057433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.064149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44675884cd6040588ac1b6b7c94970b4', 'request_id': 'req-da601504-7c49-4dea-9fb9-265853ef5efa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:11.071860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44675884cd6040588ac1b6b7c94970b4', 'request_id': 'req-da601504-7c49-4dea-9fb9-265853ef5efa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:11.081173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44675884cd6040588ac1b6b7c94970b4', 'request_id': 'req-da601504-7c49-4dea-9fb9-265853ef5efa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:11.094157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] The token cache is being invalidate because project 44675884cd6040588ac1b6b7c94970b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:11.094531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:11.095262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-da601504-7c49-4dea-9fb9-265853ef5efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:11.097255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 961/1951] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:10 2022] DELETE /identity/v3/projects/44675884cd6040588ac1b6b7c94970b4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:11.101882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd7c8-a7c5-4587-a0c4-e0a1727e0f50 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.102211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd7c8-a7c5-4587-a0c4-e0a1727e0f50 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.102688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd7c8-a7c5-4587-a0c4-e0a1727e0f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.123403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-138dd7c8-a7c5-4587-a0c4-e0a1727e0f50 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:11.124639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-138dd7c8-a7c5-4587-a0c4-e0a1727e0f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:11.147914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.149209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.149498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.150839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.152587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.155314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.197368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 962/1952] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:11.199138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5e95-8181-4100-8204-6c464861f6f5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.199560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5e95-8181-4100-8204-6c464861f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.199849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5e95-8181-4100-8204-6c464861f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.203372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 991/1953] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:11.208483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.210266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:11.245829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-25ca5e95-8181-4100-8204-6c464861f6f5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:11.248006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-25ca5e95-8181-4100-8204-6c464861f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:11.285190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdad001-3b99-4856-95e3-8b7828aedc05 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.290402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.291082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.291366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.291638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.292468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.294827 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.325662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 963/1954] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:11.327245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 992/1955] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:11.327667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5e95-8181-4100-8204-6c464861f6f5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.330649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.341366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5e95-8181-4100-8204-6c464861f6f5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.345908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc9a2b-3166-457f-9e87-67e9945544bd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.349743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.350559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.350763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.350975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.351091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.351758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.351873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.352175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.352331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.353136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:11.353488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.353588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.356012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.365400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 964/1956] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:11.369189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.370656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 993/1957] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:11.374372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.379765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a949376-4147-422a-bf1e-c9d84bb00845 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.384369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358593c-2b23-4f03-b82a-072b3f1c97f4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.385743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.386538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.386827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.387110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.387960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.389569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.390551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.391393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.392046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.392046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.392718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.394783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.405071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 965/1958] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:11.407116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.413758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.417797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f70b-c1fc-4f13-9594-98f586060b2e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.424762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03636-3ab2-4746-a21d-6cfda77232a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.426075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03636-3ab2-4746-a21d-6cfda77232a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.426788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03636-3ab2-4746-a21d-6cfda77232a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.427739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03636-3ab2-4746-a21d-6cfda77232a2 admin admin] PATH_INFO: `/v3/projects/929b487dc6394e9faaa60073658ceb6a/users/85c3869ca95d438287d841d5c45a8d59/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.430286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 994/1959] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:11.431854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.448573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c03636-3ab2-4746-a21d-6cfda77232a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929b487dc6394e9faaa60073658ceb6a, user_id=85c3869ca95d438287d841d5c45a8d59, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.451578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c03636-3ab2-4746-a21d-6cfda77232a2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.469848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 966/1960] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:11 2022] PUT /identity/v3/projects/929b487dc6394e9faaa60073658ceb6a/users/85c3869ca95d438287d841d5c45a8d59/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:11.484775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122096-5584-4712-bdb0-432bb856314c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.485075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122096-5584-4712-bdb0-432bb856314c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.485354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122096-5584-4712-bdb0-432bb856314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.496656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.507808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92cce0-e154-436f-98b0-1dbb0774e174 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.523787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-df122096-5584-4712-bdb0-432bb856314c None None] MFA Rules not processed for user `85c3869ca95d438287d841d5c45a8d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:11.525159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df122096-5584-4712-bdb0-432bb856314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:11.580397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.581077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.581360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.581830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.582568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.584513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.613407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 967/1961] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:11.613605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 995/1962] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:11.614688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df122096-5584-4712-bdb0-432bb856314c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.615334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.625673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df122096-5584-4712-bdb0-432bb856314c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.628210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8bfb4-1e23-451b-a45c-b812caaa05cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.631352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.632032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.632316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.632596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.633303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.634084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.635134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.635278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.635686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.636096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.637105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.639640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.651716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 996/1963] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:11.655564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.666658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f0c15-8b32-4b66-b09f-9fc921cc5ce7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.668010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 968/1964] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:11.671774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.725753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.726481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.726768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.727048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.727778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.729388 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.733373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d9a9-0dcb-464d-95b2-39cadce7aea5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.738153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.738930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.739221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.739502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.739826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 997/1965] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:11.740201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.742145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.743898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.754035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f22b0-e719-4962-be84-9dfbfccfa481 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.759074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.759985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.760270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.760548 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] PATH_INFO: `/v3/projects/0f6038a725904efc9bbe39b54018436c/users/56375eb8450d4b65bf62a61fa6f25162/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.767213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 969/1966] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:11.768288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.776189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6038a725904efc9bbe39b54018436c, user_id=56375eb8450d4b65bf62a61fa6f25162, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.778201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8a610-d525-408f-a18c-c818099632e9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.779051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.782957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83dcf-1d56-42b8-9732-51f7f6dfb5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.783619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83dcf-1d56-42b8-9732-51f7f6dfb5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.783903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83dcf-1d56-42b8-9732-51f7f6dfb5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.784206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83dcf-1d56-42b8-9732-51f7f6dfb5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.785014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc83dcf-1d56-42b8-9732-51f7f6dfb5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.786843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc83dcf-1d56-42b8-9732-51f7f6dfb5a1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.793885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 998/1967] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:11 2022] PUT /identity/v3/projects/0f6038a725904efc9bbe39b54018436c/users/56375eb8450d4b65bf62a61fa6f25162/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:11.797270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 970/1968] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:11.801570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.804043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745cff0-b6cf-4dcd-88e8-8b7958beb058 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.804414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745cff0-b6cf-4dcd-88e8-8b7958beb058 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.804828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745cff0-b6cf-4dcd-88e8-8b7958beb058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.831244 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7745cff0-b6cf-4dcd-88e8-8b7958beb058 None None] MFA Rules not processed for user `56375eb8450d4b65bf62a61fa6f25162`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:11.832616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7745cff0-b6cf-4dcd-88e8-8b7958beb058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:11.845237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.848349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.866760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec5be8-dc19-4114-ad85-013378c66cc9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.871540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.872447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.872733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.873019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] PATH_INFO: `/v3/projects/97dfa0b772034c1db54ab975c268f3b6/users/c282697f5d174dd691ef905449a45e0c/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.888358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dfa0b772034c1db54ab975c268f3b6, user_id=c282697f5d174dd691ef905449a45e0c, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.891085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.900817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 971/1969] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:11.905538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745cff0-b6cf-4dcd-88e8-8b7958beb058 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.908055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 999/1970] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:11 2022] PUT /identity/v3/projects/97dfa0b772034c1db54ab975c268f3b6/users/c282697f5d174dd691ef905449a45e0c/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:11.911828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.916202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745cff0-b6cf-4dcd-88e8-8b7958beb058 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.971957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.972748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.973005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.973202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.973815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bbf1-47f0-4c0b-83ab-c3eba34a2a16 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.973914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.977310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.979626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.980287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.980831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.981123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.982030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.984056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.995410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1000/1971] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:11.999818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.010236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 972/1972] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:11 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:12.011121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.011703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303f613-b37b-495f-b82f-b7da30451aaf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.070655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77429b7-8065-41d5-8ce6-1fb146be59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.071557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77429b7-8065-41d5-8ce6-1fb146be59f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.071839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77429b7-8065-41d5-8ce6-1fb146be59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.072113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77429b7-8065-41d5-8ce6-1fb146be59f6 admin admin] PATH_INFO: `/v3/projects/97dfa0b772034c1db54ab975c268f3b6/users/c282697f5d174dd691ef905449a45e0c/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.072905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ad302-133c-4082-be44-9c735b2a0771 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.074077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77429b7-8065-41d5-8ce6-1fb146be59f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dfa0b772034c1db54ab975c268f3b6, user_id=c282697f5d174dd691ef905449a45e0c, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.076774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77429b7-8065-41d5-8ce6-1fb146be59f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.077569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.078280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.078570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.078851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.079570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.081544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.087581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1001/1973] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:11 2022] PUT /identity/v3/projects/97dfa0b772034c1db54ab975c268f3b6/users/c282697f5d174dd691ef905449a45e0c/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:12.098053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.098400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.098672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.111102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 973/1974] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:12 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:12.112119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.121904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414badb-d28c-4229-8266-b1a3f7c0da83 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.128612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] MFA Rules not processed for user `c282697f5d174dd691ef905449a45e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:12.129856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:12.151405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.176117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.183099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.183692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.183952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.184238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.185061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.186958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.201404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 974/1975] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:12.202282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.204615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1002/1976] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:12.212590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44859a82-2842-4069-9dd1-5e97784d2e52 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.215895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.217090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:12.217830 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.218768 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.219057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.219335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] PATH_INFO: `/v3/projects/f5ee94a12d6f4d7686c38a6e0543c8a2/users/8819e009fae9486c80755e182ef99fe2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.235499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ee94a12d6f4d7686c38a6e0543c8a2, user_id=8819e009fae9486c80755e182ef99fe2, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.238544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.252705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 975/1977] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:12 2022] PUT /identity/v3/projects/f5ee94a12d6f4d7686c38a6e0543c8a2/users/8819e009fae9486c80755e182ef99fe2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:12.256562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.280910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced0d2-67a6-4b69-a4ad-d4b8fc85a359 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.318929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094da99f-b510-405a-9f90-46b496baef3a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.323812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.324543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.324818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.325082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.325859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.327506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.330143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.330842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.331145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.331453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.337683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 976/1978] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:12.342092 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.352628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce492ef6-3134-4fea-8bfb-fb4b69d87093 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.358437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf3d9d-d8fb-4a7f-83ed-14b1721a3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.359345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf3d9d-d8fb-4a7f-83ed-14b1721a3269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.359673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf3d9d-d8fb-4a7f-83ed-14b1721a3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.359958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf3d9d-d8fb-4a7f-83ed-14b1721a3269 admin admin] PATH_INFO: `/v3/projects/f5ee94a12d6f4d7686c38a6e0543c8a2/users/8819e009fae9486c80755e182ef99fe2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.362592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf3d9d-d8fb-4a7f-83ed-14b1721a3269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ee94a12d6f4d7686c38a6e0543c8a2, user_id=8819e009fae9486c80755e182ef99fe2, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.365404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf3d9d-d8fb-4a7f-83ed-14b1721a3269 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.380161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 977/1979] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:12 2022] PUT /identity/v3/projects/f5ee94a12d6f4d7686c38a6e0543c8a2/users/8819e009fae9486c80755e182ef99fe2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:12.391214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583f003-6a32-4be8-a1a9-e59b1c45a3e8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.391507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583f003-6a32-4be8-a1a9-e59b1c45a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.391811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583f003-6a32-4be8-a1a9-e59b1c45a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.398427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.399930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.409301 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1003/1980] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:03:12.420051 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1583f003-6a32-4be8-a1a9-e59b1c45a3e8 None None] MFA Rules not processed for user `8819e009fae9486c80755e182ef99fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:12.421433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1583f003-6a32-4be8-a1a9-e59b1c45a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:12.491158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 978/1981] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:12.502526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.513280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae750c-96c8-4a03-ab83-89e49cb2f93c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.597478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649fd3-1547-42f8-a5e9-7dc412e7a296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.598472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649fd3-1547-42f8-a5e9-7dc412e7a296 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.598852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649fd3-1547-42f8-a5e9-7dc412e7a296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.599094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649fd3-1547-42f8-a5e9-7dc412e7a296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.611582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.614960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649fd3-1547-42f8-a5e9-7dc412e7a296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.616733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649fd3-1547-42f8-a5e9-7dc412e7a296 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.631511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1004/1982] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:13.086897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583f003-6a32-4be8-a1a9-e59b1c45a3e8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.099452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:13.152429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583f003-6a32-4be8-a1a9-e59b1c45a3e8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.156962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.157848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.158131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.158445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] PATH_INFO: `/v3/users/56375eb8450d4b65bf62a61fa6f25162` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.159703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56375eb8450d4b65bf62a61fa6f25162)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.161740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.218760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56375eb8450d4b65bf62a61fa6f25162'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.225717 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56375eb8450d4b65bf62a61fa6f25162'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.235515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56375eb8450d4b65bf62a61fa6f25162'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.248630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56375eb8450d4b65bf62a61fa6f25162'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.249326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56375eb8450d4b65bf62a61fa6f25162'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.256693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 979/1983] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:13 2022] DELETE /identity/v3/users/56375eb8450d4b65bf62a61fa6f25162 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:13.261082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.261426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.261641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.280293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:13.281515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:13.344562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1005/1984] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:13.355705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.357249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:13.423753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dab3ce-6a27-45eb-8c74-9ab53abad5f7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.428124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.428787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.429072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.429374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.439492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.440966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.451158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 980/1985] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:03:13.729805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.731463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:13.744185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65409f02-6469-4a23-a849-9bda4128fbd5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.749429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.750406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.750692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.750967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] PATH_INFO: `/v3/projects/0f6038a725904efc9bbe39b54018436c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.752285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6038a725904efc9bbe39b54018436c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.754572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.811094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6038a725904efc9bbe39b54018436c', 'request_id': 'req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.818422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6038a725904efc9bbe39b54018436c', 'request_id': 'req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.828712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6038a725904efc9bbe39b54018436c', 'request_id': 'req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.848814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] The token cache is being invalidate because project 0f6038a725904efc9bbe39b54018436c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:13.849133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.849806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:13.851563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1006/1986] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:13 2022] DELETE /identity/v3/projects/0f6038a725904efc9bbe39b54018436c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:13.855610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.867481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae5ad6-2fcf-4610-b1d1-8677578e9e85 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.906708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:13.938387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.939411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.939765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.940121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] PATH_INFO: `/v3/users/8819e009fae9486c80755e182ef99fe2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.941504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8819e009fae9486c80755e182ef99fe2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.943721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.006659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8819e009fae9486c80755e182ef99fe2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.013867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8819e009fae9486c80755e182ef99fe2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.023888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8819e009fae9486c80755e182ef99fe2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.039540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8819e009fae9486c80755e182ef99fe2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.040202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ce912e8b-acd3-45a6-a191-a6dd5382160c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8819e009fae9486c80755e182ef99fe2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.046249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 981/1987] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:13 2022] DELETE /identity/v3/users/8819e009fae9486c80755e182ef99fe2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:14.333552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.335034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:14.352500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c1ac-d092-40b6-bc5c-e3a1ccda6639 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.411684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.412588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.412870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.413171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] PATH_INFO: `/v3/projects/f5ee94a12d6f4d7686c38a6e0543c8a2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.414572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ee94a12d6f4d7686c38a6e0543c8a2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.417169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.439826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:14.466675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ee94a12d6f4d7686c38a6e0543c8a2', 'request_id': 'req-4352a81b-15f4-47ab-b60b-d3eeff460bdb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.473107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ee94a12d6f4d7686c38a6e0543c8a2', 'request_id': 'req-4352a81b-15f4-47ab-b60b-d3eeff460bdb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.482945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ee94a12d6f4d7686c38a6e0543c8a2', 'request_id': 'req-4352a81b-15f4-47ab-b60b-d3eeff460bdb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.493770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] The token cache is being invalidate because project f5ee94a12d6f4d7686c38a6e0543c8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:14.494064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.494837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4352a81b-15f4-47ab-b60b-d3eeff460bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:14.496417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1007/1988] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:14 2022] DELETE /identity/v3/projects/f5ee94a12d6f4d7686c38a6e0543c8a2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:14.501410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30d0b-578c-46b4-a573-e415c40dd555 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.501888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30d0b-578c-46b4-a573-e415c40dd555 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.501981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30d0b-578c-46b4-a573-e415c40dd555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.520203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fab30d0b-578c-46b4-a573-e415c40dd555 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:14.521415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fab30d0b-578c-46b4-a573-e415c40dd555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:14.591722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 982/1989] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:14.601553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873442b2-8929-4413-8a2e-34045d6f1694 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.601853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873442b2-8929-4413-8a2e-34045d6f1694 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.602159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873442b2-8929-4413-8a2e-34045d6f1694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.621840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-873442b2-8929-4413-8a2e-34045d6f1694 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:14.623116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-873442b2-8929-4413-8a2e-34045d6f1694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:14.632043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1008/1990] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:14.636454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30d0b-578c-46b4-a573-e415c40dd555 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.646618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30d0b-578c-46b4-a573-e415c40dd555 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.651403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.652055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.652335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.652610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.653328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:14.653633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.655274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.667456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 983/1991] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:14.671916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873442b2-8929-4413-8a2e-34045d6f1694 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.681584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873442b2-8929-4413-8a2e-34045d6f1694 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.687882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.688608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.688893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.689201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.689901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.691923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.719730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1009/1992] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:14 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:14.724242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.734765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47365f0-55e3-46fd-8bfb-dcde93cbfa29 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.777916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:14.802371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.803051 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.803337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.803617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.804330 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.806302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.831045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 984/1993] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:14 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:14.835788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.846596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7d4d-ebbf-4d78-9726-b02206b68d63 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.851936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.852781 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.853063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.853346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.854142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.855813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.869066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1010/1994] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:14.873366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.884714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29e2f-97c9-46d1-b0ad-032d753207c4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.891292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9579348-857e-4988-9da5-2ca5bfaf250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.892102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579348-857e-4988-9da5-2ca5bfaf250c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.892272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579348-857e-4988-9da5-2ca5bfaf250c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.892650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9579348-857e-4988-9da5-2ca5bfaf250c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.893277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9579348-857e-4988-9da5-2ca5bfaf250c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.895118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9579348-857e-4988-9da5-2ca5bfaf250c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.910669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 985/1995] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:14.911600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.922204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70816-8abd-4b6a-acf6-1442ab33d207 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.927235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.928218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.928577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.928861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] PATH_INFO: `/v3/projects/65fd4f4a39a241d2a693c35924409c45/users/05d405e4b3c84b3ab36575dfea941926/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.945150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65fd4f4a39a241d2a693c35924409c45, user_id=05d405e4b3c84b3ab36575dfea941926, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.947853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.962905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1011/1996] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:14 2022] PUT /identity/v3/projects/65fd4f4a39a241d2a693c35924409c45/users/05d405e4b3c84b3ab36575dfea941926/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:14.973324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36bbc-0f08-474f-a8f7-ac281da38082 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.974249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36bbc-0f08-474f-a8f7-ac281da38082 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.974564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36bbc-0f08-474f-a8f7-ac281da38082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.003878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d0c36bbc-0f08-474f-a8f7-ac281da38082 None None] MFA Rules not processed for user `05d405e4b3c84b3ab36575dfea941926`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:15.005105 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d0c36bbc-0f08-474f-a8f7-ac281da38082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:15.081327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 986/1997] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:15.086398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.157853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96237af-2548-4476-96db-e5de6b846b0a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.164051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.164940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.165322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.173918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.173918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.173918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.201236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1012/1998] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:15 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:15.205290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36bbc-0f08-474f-a8f7-ac281da38082 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.216756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36bbc-0f08-474f-a8f7-ac281da38082 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.282305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.282989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.283275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.283552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.284242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.286913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.310357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 987/1999] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:15 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:15.311606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.322353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c503fb-0ece-4609-bc71-0fa2aa348b04 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.327969 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.328650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.329062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.329616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.330399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.332086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.349200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1013/2000] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:15.350678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.361746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f2a03-3355-43c0-b203-df7df23fee39 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.367583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.368510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.368796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.369086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] PATH_INFO: `/v3/projects/df7cca3813b04defa510d35b06a371cb/users/d8a6dd28befb49798e69ed805def3a4b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.386067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7cca3813b04defa510d35b06a371cb, user_id=d8a6dd28befb49798e69ed805def3a4b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.389286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.404951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 988/2001] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:15 2022] PUT /identity/v3/projects/df7cca3813b04defa510d35b06a371cb/users/d8a6dd28befb49798e69ed805def3a4b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:15.408997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.419459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4368e4-9867-4bc2-92ef-6f484b88ca52 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.436870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:15.484234 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ab135-057e-4bb8-8b9d-efc6312c14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.484919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab135-057e-4bb8-8b9d-efc6312c14e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.485205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab135-057e-4bb8-8b9d-efc6312c14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.485484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab135-057e-4bb8-8b9d-efc6312c14e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.486252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ab135-057e-4bb8-8b9d-efc6312c14e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.487855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ab135-057e-4bb8-8b9d-efc6312c14e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.497867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1014/2002] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:15.502181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.513047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a996532-9bf1-4bcb-bc82-c4e5ad6998b4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.517932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.518859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.519138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.519444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] PATH_INFO: `/v3/projects/df7cca3813b04defa510d35b06a371cb/users/d8a6dd28befb49798e69ed805def3a4b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.521580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7cca3813b04defa510d35b06a371cb, user_id=d8a6dd28befb49798e69ed805def3a4b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.524266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.530700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:15.536187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 989/2003] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:15 2022] PUT /identity/v3/projects/df7cca3813b04defa510d35b06a371cb/users/d8a6dd28befb49798e69ed805def3a4b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:15.549099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5481-77c9-4c4b-b693-7e1d9d015456 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.549397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5481-77c9-4c4b-b693-7e1d9d015456 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.549679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5481-77c9-4c4b-b693-7e1d9d015456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.579023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d05a5481-77c9-4c4b-b693-7e1d9d015456 None None] MFA Rules not processed for user `d8a6dd28befb49798e69ed805def3a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:15.580256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d05a5481-77c9-4c4b-b693-7e1d9d015456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:15.651645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1015/2004] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:15.663228 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.665076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:15.744136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878e73a-dda1-4b55-bea7-d8a9201a6db4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.748918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.749580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.749873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.750151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.759959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.761408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.771296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 990/2005] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:15.865038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5481-77c9-4c4b-b693-7e1d9d015456 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:15.875654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5481-77c9-4c4b-b693-7e1d9d015456 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:15.880286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a3fa-f156-4ade-9066-661c6c88c320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:15.880947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a3fa-f156-4ade-9066-661c6c88c320 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.881225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a3fa-f156-4ade-9066-661c6c88c320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.881501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a3fa-f156-4ade-9066-661c6c88c320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.941155 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a3fa-f156-4ade-9066-661c6c88c320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:15.942594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a3fa-f156-4ade-9066-661c6c88c320 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:15.952758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1016/2006] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:16.245411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.318190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7b138-b50f-4601-8f5d-b96fc62ac6cb service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.322715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.323607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.323894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.324175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] PATH_INFO: `/v3/users/05d405e4b3c84b3ab36575dfea941926` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.325376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d405e4b3c84b3ab36575dfea941926)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:16.327350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:16.377674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d405e4b3c84b3ab36575dfea941926'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:16.392861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d405e4b3c84b3ab36575dfea941926'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:16.402694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d405e4b3c84b3ab36575dfea941926'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:16.417573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d405e4b3c84b3ab36575dfea941926'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:16.419293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d405e4b3c84b3ab36575dfea941926'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:16.427385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 991/2007] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:16 2022] DELETE /identity/v3/users/05d405e4b3c84b3ab36575dfea941926 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:16.431777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.432175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.432423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.452224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:16.453385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:16.528192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.565173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1017/2008] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:16.575379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.576926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:16.609806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.662680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af412-84d3-4548-ac90-89e4e9aa2148 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.668572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.669409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.669697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.670226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.687182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:16.688772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:16.704089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 992/2009] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:17.259730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.261667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:17.328560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56e95-4952-4dfe-ba5e-ea500bb1034c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.343512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.344612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.344742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.345036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] PATH_INFO: `/v3/projects/65fd4f4a39a241d2a693c35924409c45` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.346952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65fd4f4a39a241d2a693c35924409c45)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.349028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.442191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65fd4f4a39a241d2a693c35924409c45', 'request_id': 'req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.454601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65fd4f4a39a241d2a693c35924409c45', 'request_id': 'req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.470520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65fd4f4a39a241d2a693c35924409c45', 'request_id': 'req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.500074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] The token cache is being invalidate because project 65fd4f4a39a241d2a693c35924409c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:17.501421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.502809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.509168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.512200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1018/2010] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:17 2022] DELETE /identity/v3/projects/65fd4f4a39a241d2a693c35924409c45 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:17.526026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164c30-ec76-4c8b-9606-11ff01ef5f65 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.646214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.647930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.648424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.648928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] PATH_INFO: `/v3/users/d8a6dd28befb49798e69ed805def3a4b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.652574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a6dd28befb49798e69ed805def3a4b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.657200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.744083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a6dd28befb49798e69ed805def3a4b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.764683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a6dd28befb49798e69ed805def3a4b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.785104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a6dd28befb49798e69ed805def3a4b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.813847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a6dd28befb49798e69ed805def3a4b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.814683 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b87c2c7b-832d-47eb-bcba-376aff3ff115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a6dd28befb49798e69ed805def3a4b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:17.825019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 993/2011] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:17 2022] DELETE /identity/v3/users/d8a6dd28befb49798e69ed805def3a4b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:18.324704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.326764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:18.361110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6bf12-2d52-4285-9f4b-cf7548c10bd1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.444732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.450352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.450352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.450567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] PATH_INFO: `/v3/projects/df7cca3813b04defa510d35b06a371cb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.451873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7cca3813b04defa510d35b06a371cb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.453829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.548986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7cca3813b04defa510d35b06a371cb', 'request_id': 'req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:18.556425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7cca3813b04defa510d35b06a371cb', 'request_id': 'req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:18.566095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7cca3813b04defa510d35b06a371cb', 'request_id': 'req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:18.571190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.583304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] The token cache is being invalidate because project df7cca3813b04defa510d35b06a371cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:18.583667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:18.584519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e9a5fb7e-2971-4568-8e0e-8a24d2e45ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:18.586487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1019/2012] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:18 2022] DELETE /identity/v3/projects/df7cca3813b04defa510d35b06a371cb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:18.593268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deffac-7144-469b-8254-4b4ae1aae9eb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.593566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deffac-7144-469b-8254-4b4ae1aae9eb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.593871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deffac-7144-469b-8254-4b4ae1aae9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.617714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-68deffac-7144-469b-8254-4b4ae1aae9eb None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:18.619110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-68deffac-7144-469b-8254-4b4ae1aae9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:18.674239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.710421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 994/2013] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:18.711670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5401c-83f1-434e-8d50-2fb3745099c1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.711999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5401c-83f1-434e-8d50-2fb3745099c1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.712404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5401c-83f1-434e-8d50-2fb3745099c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.738933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-32a5401c-83f1-434e-8d50-2fb3745099c1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:18.741130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-32a5401c-83f1-434e-8d50-2fb3745099c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:18.770183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1020/2014] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:18.773339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deffac-7144-469b-8254-4b4ae1aae9eb None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.787971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deffac-7144-469b-8254-4b4ae1aae9eb None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.804019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.805600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.806130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.806701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.807557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:18.808124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.809758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.827445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 995/2015] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:18.831855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5401c-83f1-434e-8d50-2fb3745099c1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.862145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5401c-83f1-434e-8d50-2fb3745099c1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.867363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.868133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.868483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.868831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.869764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.871971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.923339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1021/2016] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:18 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:18.928809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.940936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f6588-9221-4b10-bcbf-f5d9e0fc3b59 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.065663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.067483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.068603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.069343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.070684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.073630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.117758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 996/2017] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:18 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:19.119694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.131294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3343-2aea-432d-a09a-0de3985aa330 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.139157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.139866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.140144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.140564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.141436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.143059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.157042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1022/2018] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:19.158255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.169128 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7d6e-7618-4e7b-bd2c-61ab54bf4a24 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.175052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307def2-5204-42b7-b5a4-708ee82fd8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.175807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307def2-5204-42b7-b5a4-708ee82fd8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.176126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307def2-5204-42b7-b5a4-708ee82fd8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.176440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307def2-5204-42b7-b5a4-708ee82fd8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.177214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307def2-5204-42b7-b5a4-708ee82fd8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.178935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307def2-5204-42b7-b5a4-708ee82fd8ce admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.192978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 997/2019] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:19.195139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.207403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a894b-7f45-471e-8bc5-14b2095fd75c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.213575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.214569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.214816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.215098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] PATH_INFO: `/v3/projects/4eec872b230445749a112223130ed647/users/cd2295b8a3834b0286192511047218a1/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.231516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eec872b230445749a112223130ed647, user_id=cd2295b8a3834b0286192511047218a1, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.234615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.250226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1023/2020] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:19 2022] PUT /identity/v3/projects/4eec872b230445749a112223130ed647/users/cd2295b8a3834b0286192511047218a1/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:19.261819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.262168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.262460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.292545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] MFA Rules not processed for user `cd2295b8a3834b0286192511047218a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:19.294217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:19.392609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 998/2021] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:19.406182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.408712 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:19.488854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0467373-7c3d-4789-a720-12e8d927b549 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.498963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.499599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.499884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.500164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.512451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.514188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.545705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1024/2022] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:25.888855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.891276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:25.945339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.960279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b55bc-8571-4475-9cad-51d41da30d1a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.964054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110fea-9ec4-4f91-b611-97675725d8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.964711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110fea-9ec4-4f91-b611-97675725d8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.964996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110fea-9ec4-4f91-b611-97675725d8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.965271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110fea-9ec4-4f91-b611-97675725d8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.967104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-83110fea-9ec4-4f91-b611-97675725d8c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:26.033894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110fea-9ec4-4f91-b611-97675725d8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.035393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110fea-9ec4-4f91-b611-97675725d8c6 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.046147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 999/2023] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:28.939684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:28.941392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.021897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaae914-6172-4428-a3a1-8d073123ab9b service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.026933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.027823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.028104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.028382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] PATH_INFO: `/v3/users/7339b3922533478caa4322aed754b09a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.029581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7339b3922533478caa4322aed754b09a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.031554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.071658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.084725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7339b3922533478caa4322aed754b09a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.092260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7339b3922533478caa4322aed754b09a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.100769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7339b3922533478caa4322aed754b09a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.114881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7339b3922533478caa4322aed754b09a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.115601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7339b3922533478caa4322aed754b09a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.122099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1025/2024] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:28 2022] DELETE /identity/v3/users/7339b3922533478caa4322aed754b09a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:29.126392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.126887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.127013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.147318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:29.148863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.218703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1000/2025] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:29.230756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.232811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.338048 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4a04-dffb-4b81-958d-4fc0279e21ef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.342674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc518-9c6f-461a-a149-2a19b0bcdec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.343609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc518-9c6f-461a-a149-2a19b0bcdec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.343857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc518-9c6f-461a-a149-2a19b0bcdec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.344196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc518-9c6f-461a-a149-2a19b0bcdec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.359138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bc518-9c6f-461a-a149-2a19b0bcdec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.360642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bc518-9c6f-461a-a149-2a19b0bcdec5 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.372140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1026/2026] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:29.664438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.665931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.679009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fdfd3-5cbd-4538-a60c-b37b172cd528 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.684289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.685206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.685462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.685738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] PATH_INFO: `/v3/projects/a80d6467cb1844f0a226059c5d1964df` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.687058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80d6467cb1844f0a226059c5d1964df)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.689041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.745202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80d6467cb1844f0a226059c5d1964df', 'request_id': 'req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.751314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80d6467cb1844f0a226059c5d1964df', 'request_id': 'req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.760927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80d6467cb1844f0a226059c5d1964df', 'request_id': 'req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.772834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] The token cache is being invalidate because project a80d6467cb1844f0a226059c5d1964df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:29.773130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.773849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.775629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1001/2027] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:29 2022] DELETE /identity/v3/projects/a80d6467cb1844f0a226059c5d1964df => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:29.781637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22d6c-94dc-48ee-81ce-b04fc2fa1656 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.781994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22d6c-94dc-48ee-81ce-b04fc2fa1656 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.782312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22d6c-94dc-48ee-81ce-b04fc2fa1656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.802746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fec22d6c-94dc-48ee-81ce-b04fc2fa1656 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:29.804091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fec22d6c-94dc-48ee-81ce-b04fc2fa1656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.885141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.886702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.889938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1027/2028] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:29.898589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa291-1d3f-4431-9d98-c77953e9ca19 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.899121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa291-1d3f-4431-9d98-c77953e9ca19 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.899555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa291-1d3f-4431-9d98-c77953e9ca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.912894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba57fa-7cc1-4e49-9ccf-b4d1f410cdaa admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.919531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.920578 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.920936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.921480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] PATH_INFO: `/v3/users/4a2e472fbb8a465bac22c2edeb028aab` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.922621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-69bfa291-1d3f-4431-9d98-c77953e9ca19 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:29.922960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2e472fbb8a465bac22c2edeb028aab)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.924194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69bfa291-1d3f-4431-9d98-c77953e9ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.925104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.931732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.936122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1028/2029] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:29.941903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa291-1d3f-4431-9d98-c77953e9ca19 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.952744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa291-1d3f-4431-9d98-c77953e9ca19 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.959669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.960543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.960821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.961336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.962084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:29.962517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.964331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.978636 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1029/2030] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:29.983401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.991005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2e472fbb8a465bac22c2edeb028aab'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:29.996806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fef08-eb1d-420e-b082-858a95f80f84 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.999647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2e472fbb8a465bac22c2edeb028aab'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:30.001728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.002462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.002751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.003036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.003729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.006215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.012791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2e472fbb8a465bac22c2edeb028aab'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:30.032202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2e472fbb8a465bac22c2edeb028aab'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:30.033080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0a04210d-388e-4e98-8385-819715e6c1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2e472fbb8a465bac22c2edeb028aab'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:30.042653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1030/2031] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:29 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:30.044491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1002/2032] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:29 2022] DELETE /identity/v3/users/4a2e472fbb8a465bac22c2edeb028aab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:30.054033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.055091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.056090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.056458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.059192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:30.079247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:30.081026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:30.089133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.163508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639301f-1c47-4518-976c-5bafd84c8ebf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.165344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1003/2033] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:30.170724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.171430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.171715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.171999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.172845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.174941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.184606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.186592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:30.202051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1031/2034] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:30 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:30.205841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.218254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd20ad-feda-40c4-a24c-1b1a890924ee admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.223694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.224647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.224945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.225315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.226047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.227925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.240263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1032/2035] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:30.243902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.255374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5f31-e0ec-412d-8a0e-17b3692cfb53 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.259278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633a598-090e-48dd-a5c2-43b8cfa82144 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.260891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.261648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.261933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.262368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.263556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.263692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a320dbf-3191-4be0-8f6d-108ee228413a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.264353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320dbf-3191-4be0-8f6d-108ee228413a service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.264706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320dbf-3191-4be0-8f6d-108ee228413a service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.264881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.265165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320dbf-3191-4be0-8f6d-108ee228413a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.276103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a320dbf-3191-4be0-8f6d-108ee228413a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.279377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1033/2036] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:30.279705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a320dbf-3191-4be0-8f6d-108ee228413a service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.280644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.290710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1004/2037] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:30.293716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a51a7d-4192-420c-b72c-280c67d664e4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.299453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.300675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.301466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.301466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] PATH_INFO: `/v3/projects/80d06506691e4947b14192431bed4453/users/94dbfb6cf680454f883d43796f05c799/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.323515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d06506691e4947b14192431bed4453, user_id=94dbfb6cf680454f883d43796f05c799, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.327102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.345923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1034/2038] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:30 2022] PUT /identity/v3/projects/80d06506691e4947b14192431bed4453/users/94dbfb6cf680454f883d43796f05c799/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:30.359899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.361938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.362486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.384432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:30.386385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:30.422763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.508969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1005/2039] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:30.535501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.541211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:30.631643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b54517-a587-4906-a1cd-d277741dcade admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.635644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.637020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.637489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.637844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.653354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.658016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.688998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1035/2040] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:30.959380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.961315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:30.999079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff808-8290-4487-adac-f8d72e7e567c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.005232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.006258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.006613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.006956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] PATH_INFO: `/v3/projects/17c0b153c86e4a90ae2454fc7879fbbd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.008561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c0b153c86e4a90ae2454fc7879fbbd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.010313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.067310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c0b153c86e4a90ae2454fc7879fbbd', 'request_id': 'req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.074622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c0b153c86e4a90ae2454fc7879fbbd', 'request_id': 'req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.084756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c0b153c86e4a90ae2454fc7879fbbd', 'request_id': 'req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.100753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] The token cache is being invalidate because project 17c0b153c86e4a90ae2454fc7879fbbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:31.101055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.102052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.103946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1006/2041] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:30 2022] DELETE /identity/v3/projects/17c0b153c86e4a90ae2454fc7879fbbd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:31.108311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.128310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c829-0ebf-42e1-a196-2f5f0b16afcb service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.210722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.211198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.212076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.212333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.212723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] PATH_INFO: `/v3/users/4cd650f90ef042848a8724a9fd5bfed0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.213573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:31.213966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd650f90ef042848a8724a9fd5bfed0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.216498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.218509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.229423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf1f90-5b20-4e8f-84ad-5a044c4aecf7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.235639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.236752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.237141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.237419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] PATH_INFO: `/v3/users/85c3869ca95d438287d841d5c45a8d59` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.238911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c3869ca95d438287d841d5c45a8d59)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.241052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.281478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd650f90ef042848a8724a9fd5bfed0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.289893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd650f90ef042848a8724a9fd5bfed0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.298965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd650f90ef042848a8724a9fd5bfed0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.314085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c3869ca95d438287d841d5c45a8d59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.315344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd650f90ef042848a8724a9fd5bfed0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.316254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-96cdf2cb-5c06-470f-921c-7ebeb114f98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd650f90ef042848a8724a9fd5bfed0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.322921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c3869ca95d438287d841d5c45a8d59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.323316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1036/2042] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:31 2022] DELETE /identity/v3/users/4cd650f90ef042848a8724a9fd5bfed0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:31.336779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c3869ca95d438287d841d5c45a8d59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.355386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c3869ca95d438287d841d5c45a8d59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.356380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c3869ca95d438287d841d5c45a8d59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.370687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1007/2043] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:31 2022] DELETE /identity/v3/users/85c3869ca95d438287d841d5c45a8d59 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:31.372501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.372903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.373268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.397433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:31.399054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:31.406087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.411226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:31.474570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.535521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e40959-a23d-45de-b81b-624a8081784c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.542023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1037/2044] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:31.551921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.552928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.553347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.553867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] PATH_INFO: `/v3/users/b3ddac4144e9473fb7e235ba98c206fd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.557841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ddac4144e9473fb7e235ba98c206fd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.560860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.566254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.567967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:31.632305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ddac4144e9473fb7e235ba98c206fd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.638269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f473b4-d5c9-454d-822c-fe51c52943cb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.642400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.643350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.643793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.644297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.644414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ddac4144e9473fb7e235ba98c206fd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.655300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ddac4144e9473fb7e235ba98c206fd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.668084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.670538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.674381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ddac4144e9473fb7e235ba98c206fd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.675277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ddac4144e9473fb7e235ba98c206fd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:31.681616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1038/2045] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:31.683370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1008/2046] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:31 2022] DELETE /identity/v3/users/b3ddac4144e9473fb7e235ba98c206fd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:31.897146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.899097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:31.917304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e89d71-0681-43c5-8452-24d58ba29874 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.967752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:32.041521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.043484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.043484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.043920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] PATH_INFO: `/v3/projects/b533a357b2b74ee5a3271096d8d1ca21` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.045861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b533a357b2b74ee5a3271096d8d1ca21)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.050814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.052595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.054454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.071874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8091-3023-4605-88f5-9a9e7d147ee7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.089840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.091218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.092478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.092801 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] PATH_INFO: `/v3/projects/01da67a76fe74da69a11ac41f2beb7c2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.094839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01da67a76fe74da69a11ac41f2beb7c2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.099000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.143982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b533a357b2b74ee5a3271096d8d1ca21', 'request_id': 'req-17836e6e-9225-4615-af93-a02a2cee6d18'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.157818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b533a357b2b74ee5a3271096d8d1ca21', 'request_id': 'req-17836e6e-9225-4615-af93-a02a2cee6d18'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.174050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b533a357b2b74ee5a3271096d8d1ca21', 'request_id': 'req-17836e6e-9225-4615-af93-a02a2cee6d18'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.190634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] The token cache is being invalidate because project b533a357b2b74ee5a3271096d8d1ca21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:32.190840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.191587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-17836e6e-9225-4615-af93-a02a2cee6d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.198220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1039/2047] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:31 2022] DELETE /identity/v3/projects/b533a357b2b74ee5a3271096d8d1ca21 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:32.200364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b1b8-83b2-46f1-ac29-867674502a01 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.202776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b1b8-83b2-46f1-ac29-867674502a01 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.203584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b1b8-83b2-46f1-ac29-867674502a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.208233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01da67a76fe74da69a11ac41f2beb7c2', 'request_id': 'req-fe11d856-48f7-4930-b659-e67afbeed397'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.232252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01da67a76fe74da69a11ac41f2beb7c2', 'request_id': 'req-fe11d856-48f7-4930-b659-e67afbeed397'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.249828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e263b1b8-83b2-46f1-ac29-867674502a01 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:32.252262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e263b1b8-83b2-46f1-ac29-867674502a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.262390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01da67a76fe74da69a11ac41f2beb7c2', 'request_id': 'req-fe11d856-48f7-4930-b659-e67afbeed397'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.300548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] The token cache is being invalidate because project 01da67a76fe74da69a11ac41f2beb7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:32.301081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.308028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.314816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1009/2048] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:32 2022] DELETE /identity/v3/projects/01da67a76fe74da69a11ac41f2beb7c2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:32.318931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.321075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.379245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1040/2049] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:32.398137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.398515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.399002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.403824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:32.440886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:32.442264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.455097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1041/2050] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:32.456355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.460547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.475245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbe2c9-2e41-4726-ba34-6f92bd23c6c3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.482332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.482846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d856-48f7-4930-b659-e67afbeed397 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.483880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.484162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.484432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] PATH_INFO: `/v3/projects/929b487dc6394e9faaa60073658ceb6a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.485940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=929b487dc6394e9faaa60073658ceb6a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.488032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.489702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.491219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.491671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.492090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] PATH_INFO: `/v3/users/e190820da9ad41c5a1094f2da94ebd0a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.494186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e190820da9ad41c5a1094f2da94ebd0a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.496439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.562169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:32.572862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929b487dc6394e9faaa60073658ceb6a', 'request_id': 'req-a9b16502-afb3-4202-9deb-4050b832a31d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.580867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929b487dc6394e9faaa60073658ceb6a', 'request_id': 'req-a9b16502-afb3-4202-9deb-4050b832a31d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.589640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e190820da9ad41c5a1094f2da94ebd0a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.594009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929b487dc6394e9faaa60073658ceb6a', 'request_id': 'req-a9b16502-afb3-4202-9deb-4050b832a31d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.599653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e190820da9ad41c5a1094f2da94ebd0a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.610134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] The token cache is being invalidate because project 929b487dc6394e9faaa60073658ceb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:32.610530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.612371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e190820da9ad41c5a1094f2da94ebd0a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.612763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.615036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1042/2051] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:32 2022] DELETE /identity/v3/projects/929b487dc6394e9faaa60073658ceb6a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:32.617870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.621746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.629194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e190820da9ad41c5a1094f2da94ebd0a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.632002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e190820da9ad41c5a1094f2da94ebd0a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.646157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1010/2052] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:32 2022] DELETE /identity/v3/users/e190820da9ad41c5a1094f2da94ebd0a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:32.649727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.654169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.729980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b16502-afb3-4202-9deb-4050b832a31d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.770964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17b4b-f078-4b1d-8e5b-98ffc70e750c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.778075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.779017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.779308 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.779590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] PATH_INFO: `/v3/users/c282697f5d174dd691ef905449a45e0c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.781780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c282697f5d174dd691ef905449a45e0c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.783803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.863341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.864279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.864780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.865137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.873654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:32.873992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.885588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.896306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c282697f5d174dd691ef905449a45e0c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.898311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:32.909466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c282697f5d174dd691ef905449a45e0c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.917746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1043/2053] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:32.919017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.921309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:32.932106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c282697f5d174dd691ef905449a45e0c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.943882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2486d-3256-4de5-8509-ed6f63bf45f3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.951733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.953222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.953559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.953894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.954931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.957340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.965004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c282697f5d174dd691ef905449a45e0c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.967126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c282697f5d174dd691ef905449a45e0c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:32.980873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1011/2054] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:32 2022] DELETE /identity/v3/users/c282697f5d174dd691ef905449a45e0c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:32.983886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.986260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:33.005409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1044/2055] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:32 2022] POST /identity/v3/projects => generated 401 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:33.010317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.012323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:33.085278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f5c7-4165-436a-b44f-f9214740af88 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.126669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:33.161929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179737db-3d3e-42fd-a7fd-7b2c550c726e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.178493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.179200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.179611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.179898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.180618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.182675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.227657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.228576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.228870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.229152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] PATH_INFO: `/v3/projects/ff1881be0a0d4706bc387e3494314c33` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.231143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1045/2056] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/users => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:33.235278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1881be0a0d4706bc387e3494314c33)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.236659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.237340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.249939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eadc5-e69b-40b0-a51b-e2f38abaa286 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.257094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.258325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.258845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.259319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.260299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.263091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.278566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1046/2057] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:33.282525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.295660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf7076-e187-45e1-9e63-48483aa42af8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.302176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.303440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.303946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.304443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.305649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.309099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.359591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1881be0a0d4706bc387e3494314c33', 'request_id': 'req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:33.369368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1047/2058] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:33.372685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1881be0a0d4706bc387e3494314c33', 'request_id': 'req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:33.377402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.398798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1881be0a0d4706bc387e3494314c33', 'request_id': 'req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:33.403196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39758784-82f9-4b04-bb8a-1b91931cc0ea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.421049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] The token cache is being invalidate because project ff1881be0a0d4706bc387e3494314c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:33.421663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:33.424856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0fc7eec3-ddcc-4559-b8df-9e7573a16b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:33.429293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1012/2059] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:32 2022] DELETE /identity/v3/projects/ff1881be0a0d4706bc387e3494314c33 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:33.434821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb868c2-bd51-46b4-a35b-64f812b5091d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.435334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb868c2-bd51-46b4-a35b-64f812b5091d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.435764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb868c2-bd51-46b4-a35b-64f812b5091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.453350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:33.471110 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4eb868c2-bd51-46b4-a35b-64f812b5091d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:33.472250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4eb868c2-bd51-46b4-a35b-64f812b5091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:33.510971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02350e6d-1c08-4cf2-8bf1-d658511dc2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.512053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02350e6d-1c08-4cf2-8bf1-d658511dc2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.512429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02350e6d-1c08-4cf2-8bf1-d658511dc2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.512806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02350e6d-1c08-4cf2-8bf1-d658511dc2aa admin admin] PATH_INFO: `/v3/projects/04675a396e964fd7b2339f1eade05f62/users/413072ef0b8e461c89541e573baeee3b/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.535801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02350e6d-1c08-4cf2-8bf1-d658511dc2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=04675a396e964fd7b2339f1eade05f62, user_id=413072ef0b8e461c89541e573baeee3b, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.542053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02350e6d-1c08-4cf2-8bf1-d658511dc2aa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.588424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1048/2060] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:33 2022] PUT /identity/v3/projects/04675a396e964fd7b2339f1eade05f62/users/413072ef0b8e461c89541e573baeee3b/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:33.589971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1013/2061] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:33.592006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d1827-325f-4e74-ad3a-42a2106af67b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.592927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.593353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d1827-325f-4e74-ad3a-42a2106af67b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.593644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d1827-325f-4e74-ad3a-42a2106af67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.594547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.594983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.620896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b3d1827-325f-4e74-ad3a-42a2106af67b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:33.623599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b3d1827-325f-4e74-ad3a-42a2106af67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:33.665478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] MFA Rules not processed for user `413072ef0b8e461c89541e573baeee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:33.669143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:33.736816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1049/2062] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:33.742029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d1827-325f-4e74-ad3a-42a2106af67b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.775239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d1827-325f-4e74-ad3a-42a2106af67b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.790678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.794753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.795306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.795668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.796495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:33.802416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.804611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.831461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1050/2063] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:33.831994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1014/2064] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:33.836478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.836770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.840562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:33.848229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e912f-cb55-48b9-b98e-e76db79b2aa8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.859516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.860419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.860643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.860930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.861645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.864558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.888998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242816-7f9f-4e5b-ab56-d9fad689344d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.898759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.899462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.899754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.900091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.900812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.902849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.927194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1051/2065] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:33.928711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.936264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:33.989102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1015/2066] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:33.990533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.058956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9704492-9495-40db-be6a-8d99639e65ae admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.077755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb37dc3-6c7b-4186-a297-970aed361f23 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.083577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.084590 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.084971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.085339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.086726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.088384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.120855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:34.128403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1016/2067] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/users => generated 306 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:34.132960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.135344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.136077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.136390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.136672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.137551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.139668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.146078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702f54-e315-4389-9a9e-56eca837ba01 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.152689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.153572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.153977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.154450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.157000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.158945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.168439 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1052/2068] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:34.169398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.176671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1017/2069] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:34.177829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.181918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2eb73-350a-4937-a382-c877d8a5f7fd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.188005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.189010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.189424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.189926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.190998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.191440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dc9a5-d36b-4b8b-aeb5-651bb8899b04 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.193057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.198921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.200563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.201766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.203002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] PATH_INFO: `/v3/projects/5ed98dbe006941a9b948b5e61ba751dc/users/f3bf5daea5234018bbe19a8d1fb2522b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.210694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1053/2070] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:34.211501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.228429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed98dbe006941a9b948b5e61ba751dc, user_id=f3bf5daea5234018bbe19a8d1fb2522b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.231212 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.234886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246aaaa-7756-4c69-b72b-411e76133475 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.248391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.249631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.250187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.250187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.251163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.253852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.260491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1018/2071] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:34 2022] PUT /identity/v3/projects/5ed98dbe006941a9b948b5e61ba751dc/users/f3bf5daea5234018bbe19a8d1fb2522b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:34.264393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.271965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1054/2072] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:34.278987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.305088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c95a1-80c3-4b5c-8aca-1dbc66caf13f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.373337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e20ba-196e-44a2-b2ee-045c716c4f70 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.380013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.380706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.380988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.381431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.382681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.384669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.402023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1019/2073] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:34.402023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.404899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:34.423063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.424165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.424459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.424741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] PATH_INFO: `/v3/projects/3f221f35a61241928b6caa0f52a7af3b/users/d0b6052261c849acba8bc9f57c7c790a/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.424908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75969-6c46-4611-99d7-da3eb2112ad0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.431277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.432556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.432844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.433125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] PATH_INFO: `/v3/projects/97dfa0b772034c1db54ab975c268f3b6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.434536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dfa0b772034c1db54ab975c268f3b6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.436681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.468560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f221f35a61241928b6caa0f52a7af3b, user_id=d0b6052261c849acba8bc9f57c7c790a, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.474275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.500696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1055/2074] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:34 2022] PUT /identity/v3/projects/3f221f35a61241928b6caa0f52a7af3b/users/d0b6052261c849acba8bc9f57c7c790a/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:34.502199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.507404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dfa0b772034c1db54ab975c268f3b6', 'request_id': 'req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:34.510851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:34.517738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dfa0b772034c1db54ab975c268f3b6', 'request_id': 'req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:34.554535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dfa0b772034c1db54ab975c268f3b6', 'request_id': 'req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:34.571541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] The token cache is being invalidate because project 97dfa0b772034c1db54ab975c268f3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:34.572905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:34.574443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-645709b6-60b4-46f9-8df0-0cbfc19eaa1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:34.582459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1020/2075] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:34 2022] DELETE /identity/v3/projects/97dfa0b772034c1db54ab975c268f3b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:34.584971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd647a-c00a-4709-8bbb-3d02a6e3540d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.585443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd647a-c00a-4709-8bbb-3d02a6e3540d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.585794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd647a-c00a-4709-8bbb-3d02a6e3540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.615648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e7ad-2536-49b1-95e7-9bcf1c9ba0ac admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.629362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-99dd647a-c00a-4709-8bbb-3d02a6e3540d None None] MFA Rules not processed for user `d0b6052261c849acba8bc9f57c7c790a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:34.634068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-99dd647a-c00a-4709-8bbb-3d02a6e3540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:34.692018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:34.729952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe859-ebcd-4504-be91-f46d890616f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.731124 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe859-ebcd-4504-be91-f46d890616f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.731415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe859-ebcd-4504-be91-f46d890616f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.732928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe859-ebcd-4504-be91-f46d890616f9 admin admin] PATH_INFO: `/v3/projects/5ed98dbe006941a9b948b5e61ba751dc/users/f3bf5daea5234018bbe19a8d1fb2522b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.735659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fe859-ebcd-4504-be91-f46d890616f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed98dbe006941a9b948b5e61ba751dc, user_id=f3bf5daea5234018bbe19a8d1fb2522b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.740248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fe859-ebcd-4504-be91-f46d890616f9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.757502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1056/2076] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:34 2022] PUT /identity/v3/projects/5ed98dbe006941a9b948b5e61ba751dc/users/f3bf5daea5234018bbe19a8d1fb2522b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:34.762492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1021/2077] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:34.764822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.768424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccfe3-d0a9-4ac7-ad3d-f983112a30ab None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.768810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccfe3-d0a9-4ac7-ad3d-f983112a30ab None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.768910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.769112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccfe3-d0a9-4ac7-ad3d-f983112a30ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.769230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.799037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:34.800292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:34.804581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a25ccfe3-d0a9-4ac7-ad3d-f983112a30ab None None] MFA Rules not processed for user `f3bf5daea5234018bbe19a8d1fb2522b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:34.805827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a25ccfe3-d0a9-4ac7-ad3d-f983112a30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:34.906960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1057/2078] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:34.908302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.910964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:34.938682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1022/2079] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:34.938682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.938682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.943003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.993830 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:34.995264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.006540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1023/2080] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:35.006540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.006540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.047562 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.065873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac1dbe-4861-4454-82ba-9f4fb47575ca None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.070075 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.070759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.071042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.071320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.133122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24aa11-ee81-4eb2-acc7-ea9cad4fe143 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.142728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.143410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.143698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.143975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.164719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.166651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.191614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1024/2081] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:35.192640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.209174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.211629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.212928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc366-32dd-42e4-8be8-f7b825cea042 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.222089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.222867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.223275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.223715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.224458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:35.224794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.230232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.239818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1058/2082] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:35.267595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.269324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.278163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1025/2083] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:35.287076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.298453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb64de-370f-459f-b1c3-c15d5519c3f2 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.315306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed583b-ad1d-44eb-a28f-caeca6ff04d4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.344066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.344782 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.345069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.345351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.346139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.350201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.354262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.354769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.356092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] PATH_INFO: `/v3/users/d0b6052261c849acba8bc9f57c7c790a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.359029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b6052261c849acba8bc9f57c7c790a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.360351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.367944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.497389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1026/2084] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:35 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:35.497389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.507746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b6052261c849acba8bc9f57c7c790a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:35.516229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b6052261c849acba8bc9f57c7c790a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:35.531843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.541245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b6052261c849acba8bc9f57c7c790a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:35.564338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b6052261c849acba8bc9f57c7c790a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:35.566888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b6052261c849acba8bc9f57c7c790a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:35.580859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1059/2085] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:35 2022] DELETE /identity/v3/users/d0b6052261c849acba8bc9f57c7c790a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:35.581838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.589417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.636089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3445-da94-4db5-b541-f30cb71fd6b8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.756535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29010-83f0-46b0-9eaf-f77b55dc7a87 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.771648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c99ad-8f91-4994-bb95-d057949a802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.771884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.771998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c99ad-8f91-4994-bb95-d057949a802a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.772176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c99ad-8f91-4994-bb95-d057949a802a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.772295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.772451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c99ad-8f91-4994-bb95-d057949a802a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.772958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.773149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c99ad-8f91-4994-bb95-d057949a802a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.773420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.775482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.778668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c99ad-8f91-4994-bb95-d057949a802a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.821150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.827140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1060/2086] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:35 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:35.831531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b952ddc-4b88-4b3a-a304-c617635d046d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.831851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b952ddc-4b88-4b3a-a304-c617635d046d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.832161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b952ddc-4b88-4b3a-a304-c617635d046d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.868754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4b952ddc-4b88-4b3a-a304-c617635d046d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:35.870135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4b952ddc-4b88-4b3a-a304-c617635d046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.878508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.880847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.893334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1061/2087] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:35.893334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b952ddc-4b88-4b3a-a304-c617635d046d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.909294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b952ddc-4b88-4b3a-a304-c617635d046d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.913444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1027/2088] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:35.923870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.924566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.924848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.925116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.925843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.930077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.933209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.934894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.955408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1062/2089] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:35.959824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.983126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb5e1-d02d-4760-980f-ad3dacc35a7b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.996847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.997682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.997990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.998298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.999045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.001584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.030960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1063/2090] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:36.035664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.058529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d8c9-3c61-467d-aabd-653bf208fdf3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.071576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.072489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.072768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.073043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] PATH_INFO: `/v3/projects/5dd5c1a4883e4d1ab6b28028198afec5/users/1a9e50ebb5e84e30b685d50b5adae751/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.073668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c747ae-30b8-4ced-b20e-697000b90d6c service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.083814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32e1b5-c02e-40f5-b6c9-8b5a5602257b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.084880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e1b5-c02e-40f5-b6c9-8b5a5602257b service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.085368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e1b5-c02e-40f5-b6c9-8b5a5602257b service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.085882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e1b5-c02e-40f5-b6c9-8b5a5602257b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.110261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32e1b5-c02e-40f5-b6c9-8b5a5602257b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.113370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32e1b5-c02e-40f5-b6c9-8b5a5602257b service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.117056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd5c1a4883e4d1ab6b28028198afec5, user_id=1a9e50ebb5e84e30b685d50b5adae751, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.119973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.138193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1028/2091] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:36.158927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1064/2092] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:36 2022] PUT /identity/v3/projects/5dd5c1a4883e4d1ab6b28028198afec5/users/1a9e50ebb5e84e30b685d50b5adae751/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:36.162427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6139-f714-402a-9cd2-745231f11e4a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.162845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6139-f714-402a-9cd2-745231f11e4a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.163128 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6139-f714-402a-9cd2-745231f11e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.205146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2d6a6139-f714-402a-9cd2-745231f11e4a None None] MFA Rules not processed for user `1a9e50ebb5e84e30b685d50b5adae751`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:36.207165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2d6a6139-f714-402a-9cd2-745231f11e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:36.256982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.392752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1029/2093] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:36.432647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.435342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:36.648067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b104f4-8e2e-4d06-9bcf-49945cf69fd4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.659030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679956be-f0d0-4e4d-a287-a10fc4bf95ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.659957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679956be-f0d0-4e4d-a287-a10fc4bf95ae service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.660582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679956be-f0d0-4e4d-a287-a10fc4bf95ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.661998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679956be-f0d0-4e4d-a287-a10fc4bf95ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.683889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679956be-f0d0-4e4d-a287-a10fc4bf95ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.686480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679956be-f0d0-4e4d-a287-a10fc4bf95ae service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.721321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1065/2094] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:36.746427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6139-f714-402a-9cd2-745231f11e4a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.865129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6139-f714-402a-9cd2-745231f11e4a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.871496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.872409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.872692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.872969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] PATH_INFO: `/v3/users/1a9e50ebb5e84e30b685d50b5adae751` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.874781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9e50ebb5e84e30b685d50b5adae751)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.877390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.025821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9e50ebb5e84e30b685d50b5adae751'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:37.040598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9e50ebb5e84e30b685d50b5adae751'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:37.068863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9e50ebb5e84e30b685d50b5adae751'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:37.114737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9e50ebb5e84e30b685d50b5adae751'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:37.115606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9e50ebb5e84e30b685d50b5adae751'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:37.125840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1030/2095] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:36 2022] DELETE /identity/v3/users/1a9e50ebb5e84e30b685d50b5adae751 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:37.129980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.130369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.130701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.155104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:37.156673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:37.248366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1066/2096] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:37.268477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:37.270550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:37.339477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:37.364974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1946b-5460-4b1c-819a-9707d192246c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.371835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8190f7-4d82-4105-a447-a0dc52c312f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.372324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8190f7-4d82-4105-a447-a0dc52c312f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.372737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8190f7-4d82-4105-a447-a0dc52c312f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.373428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8190f7-4d82-4105-a447-a0dc52c312f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.391634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8190f7-4d82-4105-a447-a0dc52c312f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.392669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8190f7-4d82-4105-a447-a0dc52c312f1 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.406489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1031/2097] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:37.796230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:37.800568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:37.847240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4d4ad-4113-4315-b6f7-f2db3973aacf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.853069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.854005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.855796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.855796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] PATH_INFO: `/v3/projects/3f221f35a61241928b6caa0f52a7af3b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.856716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f221f35a61241928b6caa0f52a7af3b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.859498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.962127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:37.969600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f221f35a61241928b6caa0f52a7af3b', 'request_id': 'req-7342d503-8291-4ec9-a6f2-aaf36cece64e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:37.997771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f221f35a61241928b6caa0f52a7af3b', 'request_id': 'req-7342d503-8291-4ec9-a6f2-aaf36cece64e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:38.016530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f221f35a61241928b6caa0f52a7af3b', 'request_id': 'req-7342d503-8291-4ec9-a6f2-aaf36cece64e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:38.037944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] The token cache is being invalidate because project 3f221f35a61241928b6caa0f52a7af3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:38.038303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:38.041566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7342d503-8291-4ec9-a6f2-aaf36cece64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:38.043805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1067/2098] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:37 2022] DELETE /identity/v3/projects/3f221f35a61241928b6caa0f52a7af3b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:38.049173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5715-8ca8-4d10-9348-81b2c0f3afdd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.049566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5715-8ca8-4d10-9348-81b2c0f3afdd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.050439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5715-8ca8-4d10-9348-81b2c0f3afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.094271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-345b5715-8ca8-4d10-9348-81b2c0f3afdd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:38.096121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-345b5715-8ca8-4d10-9348-81b2c0f3afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:38.300157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1032/2099] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:38.307909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee271-4463-4237-8186-b6380854307f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.308401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee271-4463-4237-8186-b6380854307f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.308780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee271-4463-4237-8186-b6380854307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.366375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-760ee271-4463-4237-8186-b6380854307f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:38.370809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-760ee271-4463-4237-8186-b6380854307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:38.387870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1068/2100] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:38.391777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b5715-8ca8-4d10-9348-81b2c0f3afdd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.414253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b5715-8ca8-4d10-9348-81b2c0f3afdd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.423272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.424282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.424808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.425276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.426800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:38.427314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.429350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.452238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1033/2101] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:38.456701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ee271-4463-4237-8186-b6380854307f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.473951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ee271-4463-4237-8186-b6380854307f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.495384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.497912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.498361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.498750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.501243 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.503447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.600615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1069/2102] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:38 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:38.604507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.618444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7ef0-04c6-45ed-9e1c-aa2f5e73eb1b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.725038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.726012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.726489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.726864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.727842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.730043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.767547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1034/2103] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:38 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:38.772005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.783588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bf518-01b7-48fc-b300-68a887b549cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.789266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.789953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.790360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.790649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.791384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.793019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.805264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1070/2104] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:38.810207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.832811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2940a2-f303-43d3-a6d0-0c45a86fa715 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.840908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7863d4-c0c6-4ca4-9960-d1d968dd9f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.842279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7863d4-c0c6-4ca4-9960-d1d968dd9f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.842577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7863d4-c0c6-4ca4-9960-d1d968dd9f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.842844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7863d4-c0c6-4ca4-9960-d1d968dd9f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.843606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7863d4-c0c6-4ca4-9960-d1d968dd9f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.845240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7863d4-c0c6-4ca4-9960-d1d968dd9f0a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.882163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.883703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1035/2105] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:38.885280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3377-006c-4f07-8b49-26921d60b301 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.885575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3377-006c-4f07-8b49-26921d60b301 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.885870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3377-006c-4f07-8b49-26921d60b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.888314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:38.920881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfd02-e22b-4a78-a455-307033ed0ba4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.922773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6b2e3377-006c-4f07-8b49-26921d60b301 None None] MFA Rules not processed for user `94dbfb6cf680454f883d43796f05c799`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:38.924101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6b2e3377-006c-4f07-8b49-26921d60b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:38.926166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.927183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.927471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.927908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] PATH_INFO: `/v3/projects/5dd5c1a4883e4d1ab6b28028198afec5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.929368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd5c1a4883e4d1ab6b28028198afec5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.931961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.990294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:39.000673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd5c1a4883e4d1ab6b28028198afec5', 'request_id': 'req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:39.010184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd5c1a4883e4d1ab6b28028198afec5', 'request_id': 'req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:39.022412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd5c1a4883e4d1ab6b28028198afec5', 'request_id': 'req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:39.026615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1036/2106] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:39.030230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e3377-006c-4f07-8b49-26921d60b301 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.038927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] The token cache is being invalidate because project 5dd5c1a4883e4d1ab6b28028198afec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:39.039270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:39.039916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:39.041869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e3377-006c-4f07-8b49-26921d60b301 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.044946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1071/2107] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:38 2022] DELETE /identity/v3/projects/5dd5c1a4883e4d1ab6b28028198afec5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:39.045783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.048491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:39.118412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092b163-1f09-49cc-891b-d10f559c5062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.120005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092b163-1f09-49cc-891b-d10f559c5062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.120734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092b163-1f09-49cc-891b-d10f559c5062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.121451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092b163-1f09-49cc-891b-d10f559c5062 admin admin] PATH_INFO: `/v3/projects/af75b3bad7894bc5a7458da28a4406b0/users/a7a6708049d24deda287408781bcebe3/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.132286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f4a9a-1b2e-41ca-ad31-db4bc6acef79 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.138209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f44d52-a2d7-414c-a557-250a09cd7ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.139040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f44d52-a2d7-414c-a557-250a09cd7ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.139331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f44d52-a2d7-414c-a557-250a09cd7ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.139536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092b163-1f09-49cc-891b-d10f559c5062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af75b3bad7894bc5a7458da28a4406b0, user_id=a7a6708049d24deda287408781bcebe3, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.139638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f44d52-a2d7-414c-a557-250a09cd7ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.141725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f44d52-a2d7-414c-a557-250a09cd7ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.142347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f44d52-a2d7-414c-a557-250a09cd7ee3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.142454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092b163-1f09-49cc-891b-d10f559c5062 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.165574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1037/2108] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:39 2022] PUT /identity/v3/projects/af75b3bad7894bc5a7458da28a4406b0/users/a7a6708049d24deda287408781bcebe3/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:39.166951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8b42-6a83-49a9-a185-40f166a6140b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.167241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8b42-6a83-49a9-a185-40f166a6140b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.167533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8b42-6a83-49a9-a185-40f166a6140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.186538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1072/2109] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:39.188441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b487cc-9801-4a62-be2e-948b25763ffe None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.188581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e76e8b42-6a83-49a9-a185-40f166a6140b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:39.189085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b487cc-9801-4a62-be2e-948b25763ffe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.189865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e76e8b42-6a83-49a9-a185-40f166a6140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:39.190627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b487cc-9801-4a62-be2e-948b25763ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.197681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:39.231200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-25b487cc-9801-4a62-be2e-948b25763ffe None None] MFA Rules not processed for user `a7a6708049d24deda287408781bcebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:39.232886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25b487cc-9801-4a62-be2e-948b25763ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:39.277004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1038/2110] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:39.277004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e8b42-6a83-49a9-a185-40f166a6140b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.283131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e8b42-6a83-49a9-a185-40f166a6140b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.288878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.289864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.290409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.290882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.291885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.294094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.320660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1073/2111] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:39.320660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.320660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.320660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.324097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1039/2112] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/users => generated 298 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:39.331710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.339946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:39.341450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:39.344086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9556d6-6c2d-453b-a57b-9e3cf8e7f3a5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.349582 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.350348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.350635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.350957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.351808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.358339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.366264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1074/2113] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:39.368811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.371177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:39.373071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1040/2114] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:39.374275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.403656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce76aff-385a-4e0e-8e4d-13af08835675 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.423395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.424089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.424376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.424651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.425392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:39.426357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.428223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.443914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1041/2115] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:39.444940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.455491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c337d-f482-454a-8db1-3b2868454324 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.461738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.462807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.463211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.463559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] PATH_INFO: `/v3/projects/224c2871117145cf9054e9e3dc1bc547/users/b3729f6d1d97450c88bc3004a70d88f1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.471507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22753e-acaf-402a-b469-eddbc5ed67f4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.483291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.484122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.485084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.486445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.494947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=224c2871117145cf9054e9e3dc1bc547, user_id=b3729f6d1d97450c88bc3004a70d88f1, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.498565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.500616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.503193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.512575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:39.515659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1075/2116] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:39.516820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.524168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1042/2117] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:39 2022] PUT /identity/v3/projects/224c2871117145cf9054e9e3dc1bc547/users/b3729f6d1d97450c88bc3004a70d88f1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:39.526221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.545763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b447-3350-4dd2-83f2-1e65fc0cbd5a service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.657578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.658390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.658742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.659022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.659722 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.661935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.681299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25bf1-3689-4d61-a64f-e896e27c4b8d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.697402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.698218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.698615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.698915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.699797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.701990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.716726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1076/2118] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:39.717792 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.740879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:39.746523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1043/2119] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:39.756120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.779792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a85a9-33c0-4d62-a86d-707ca144ca14 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.856486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb20d-0cc9-4883-a3e1-2ee6ab8512cf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.871144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.871907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.872288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.872467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.873298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.875214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.916460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.917564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.918389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.918743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] PATH_INFO: `/v3/projects/224c2871117145cf9054e9e3dc1bc547/users/b3729f6d1d97450c88bc3004a70d88f1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.928433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1077/2120] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:39.933157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.937258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224c2871117145cf9054e9e3dc1bc547, user_id=b3729f6d1d97450c88bc3004a70d88f1, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.942432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.956497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9c62-5059-4ce9-ad3b-0ddbf1ace4b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.967670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1044/2121] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:39 2022] PUT /identity/v3/projects/224c2871117145cf9054e9e3dc1bc547/users/b3729f6d1d97450c88bc3004a70d88f1/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:40.131101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.131101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.131101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.131101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.131456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.132816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.144511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1078/2122] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:40.148576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.159275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a77d3-51c1-4354-a74e-0ada6c5cdda5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.176664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527aa2d-c01e-4cc6-92bb-d6795999b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.177422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527aa2d-c01e-4cc6-92bb-d6795999b5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.178475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527aa2d-c01e-4cc6-92bb-d6795999b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.178765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527aa2d-c01e-4cc6-92bb-d6795999b5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.180383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527aa2d-c01e-4cc6-92bb-d6795999b5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.182282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527aa2d-c01e-4cc6-92bb-d6795999b5ea admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.200904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1045/2123] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:40.205029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.216368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1742-6bd4-4d6c-ac40-bee409a818be admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.221026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.221941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.222258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.222540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] PATH_INFO: `/v3/projects/9508a7f689df421f8defccb251e6c508/users/5132171268ad44b1bf5821ed85849539/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.251136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9508a7f689df421f8defccb251e6c508, user_id=5132171268ad44b1bf5821ed85849539, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.253830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.286071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1079/2124] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:40 2022] PUT /identity/v3/projects/9508a7f689df421f8defccb251e6c508/users/5132171268ad44b1bf5821ed85849539/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:40.287795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff380a-a4cb-45db-9daa-c380c60df3fb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.288703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff380a-a4cb-45db-9daa-c380c60df3fb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.289008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff380a-a4cb-45db-9daa-c380c60df3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.335273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-19ff380a-a4cb-45db-9daa-c380c60df3fb None None] MFA Rules not processed for user `5132171268ad44b1bf5821ed85849539`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:40.337149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-19ff380a-a4cb-45db-9daa-c380c60df3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:40.444165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.445954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1046/2125] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:40.531844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a063d-66c3-4f8d-a325-0b694e0d4a30 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.539818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.540677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.540968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.541249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.541966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.543946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.572523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.586150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff380a-a4cb-45db-9daa-c380c60df3fb None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.590218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1080/2126] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:40 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:40.599037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff380a-a4cb-45db-9daa-c380c60df3fb None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.603967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.669691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.670445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.670733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.671011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.671715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.673668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.703885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1047/2127] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:40 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:40.705517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.727267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4591a3-c99f-4b8d-aa22-3f61ce2f56ca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.735754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.737029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.737412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.739547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.740532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.745284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.767346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1081/2128] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:40.771368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.786967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc137e7-2822-4647-a659-567448f9cffe admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.793921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.795095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.795814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.796509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] PATH_INFO: `/v3/projects/711794aab0bf438a9fc8b50311b69c13/users/f9280ea5eccc445ba1843ea3cd27cace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.821675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711794aab0bf438a9fc8b50311b69c13, user_id=f9280ea5eccc445ba1843ea3cd27cace, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.824933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.873367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1048/2129] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:40 2022] PUT /identity/v3/projects/711794aab0bf438a9fc8b50311b69c13/users/f9280ea5eccc445ba1843ea3cd27cace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:40.875650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.903684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9794c-8244-43e8-8048-d40252b504a5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.013747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4d999-02ae-4441-ba12-c8ad767220d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.014670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d999-02ae-4441-ba12-c8ad767220d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.015477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d999-02ae-4441-ba12-c8ad767220d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.016426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d999-02ae-4441-ba12-c8ad767220d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.017195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4d999-02ae-4441-ba12-c8ad767220d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.020440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4d999-02ae-4441-ba12-c8ad767220d0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.032784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1082/2130] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:41.037168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.064933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92420-db4d-46be-8f1d-53f064c1e1c5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.072072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.075194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.076223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.076880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] PATH_INFO: `/v3/projects/711794aab0bf438a9fc8b50311b69c13/users/f9280ea5eccc445ba1843ea3cd27cace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.086182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711794aab0bf438a9fc8b50311b69c13, user_id=f9280ea5eccc445ba1843ea3cd27cace, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.089345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.114032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1049/2131] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:41 2022] PUT /identity/v3/projects/711794aab0bf438a9fc8b50311b69c13/users/f9280ea5eccc445ba1843ea3cd27cace/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:41.115953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1df11b-e5c3-4dd1-a651-e48b4d9b4234 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.116250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1df11b-e5c3-4dd1-a651-e48b4d9b4234 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.116576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1df11b-e5c3-4dd1-a651-e48b4d9b4234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.176608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ae1df11b-e5c3-4dd1-a651-e48b4d9b4234 None None] MFA Rules not processed for user `f9280ea5eccc445ba1843ea3cd27cace`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:41.178065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae1df11b-e5c3-4dd1-a651-e48b4d9b4234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:41.230600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.232427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:41.395975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f2c3c-9aa1-470e-96e5-51b6e99ad9b6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.402298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1083/2132] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:41.415312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.415812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1df11b-e5c3-4dd1-a651-e48b4d9b4234 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.416657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.417071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.417490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] PATH_INFO: `/v3/users/413072ef0b8e461c89541e573baeee3b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.418968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=413072ef0b8e461c89541e573baeee3b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.421085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.530224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413072ef0b8e461c89541e573baeee3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:41.549181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413072ef0b8e461c89541e573baeee3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:41.555495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.569588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413072ef0b8e461c89541e573baeee3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:41.574882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1df11b-e5c3-4dd1-a651-e48b4d9b4234 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.587833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.588959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.589540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.589958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.595359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413072ef0b8e461c89541e573baeee3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:41.596226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-325ca933-27d5-4cd0-ba0e-00df56c32faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413072ef0b8e461c89541e573baeee3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:41.613102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1050/2133] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:41 2022] DELETE /identity/v3/users/413072ef0b8e461c89541e573baeee3b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:41.617488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.617777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.618059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.629383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.653843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:41.655127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:41.704097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.707187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.721958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1084/2134] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:41.762773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1051/2135] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:41.789938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.791922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:41.892292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af40e-0965-40e4-afca-b9475bb69926 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.977214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.977877 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.978459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.978741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.015770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:42.019329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:42.034671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1085/2136] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:42.913595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:42.915682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:42.934815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f56f6e-565b-4873-acbd-c0d458589600 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:42.944206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:42.945137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.945487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.946254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] PATH_INFO: `/v3/projects/04675a396e964fd7b2339f1eade05f62` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.947353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04675a396e964fd7b2339f1eade05f62)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:42.949483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:43.047882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04675a396e964fd7b2339f1eade05f62', 'request_id': 'req-1d444d1b-e0e2-4754-a0d2-1e750188547d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.057272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04675a396e964fd7b2339f1eade05f62', 'request_id': 'req-1d444d1b-e0e2-4754-a0d2-1e750188547d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.069037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04675a396e964fd7b2339f1eade05f62', 'request_id': 'req-1d444d1b-e0e2-4754-a0d2-1e750188547d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.082748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] The token cache is being invalidate because project 04675a396e964fd7b2339f1eade05f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:43.083334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.084245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.087380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1052/2137] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:42 2022] DELETE /identity/v3/projects/04675a396e964fd7b2339f1eade05f62 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:43.092549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:43.111653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d78eb-f7cd-4cd7-bab6-e3007ebd0315 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:43.193661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:43.195958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:43.197323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:43.197614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] PATH_INFO: `/v3/users/f3bf5daea5234018bbe19a8d1fb2522b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:43.201736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bf5daea5234018bbe19a8d1fb2522b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:43.205581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:43.280374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:43.309657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bf5daea5234018bbe19a8d1fb2522b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.328039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bf5daea5234018bbe19a8d1fb2522b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.343920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bf5daea5234018bbe19a8d1fb2522b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.371374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bf5daea5234018bbe19a8d1fb2522b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.372251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82da2cc4-55de-46a1-8bd3-8d3f811382b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bf5daea5234018bbe19a8d1fb2522b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:43.384113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1086/2138] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:43 2022] DELETE /identity/v3/users/f3bf5daea5234018bbe19a8d1fb2522b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:43.814477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:43.816196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:43.840259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d444d1b-e0e2-4754-a0d2-1e750188547d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:43.936450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:43.937519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:43.938384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:43.938666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] PATH_INFO: `/v3/projects/5ed98dbe006941a9b948b5e61ba751dc` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:43.940322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed98dbe006941a9b948b5e61ba751dc)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:43.944499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:43.947496 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:44.012021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed98dbe006941a9b948b5e61ba751dc', 'request_id': 'req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:44.018950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed98dbe006941a9b948b5e61ba751dc', 'request_id': 'req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:44.029040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed98dbe006941a9b948b5e61ba751dc', 'request_id': 'req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:44.044137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] The token cache is being invalidate because project 5ed98dbe006941a9b948b5e61ba751dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:44.044884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:44.045237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8132d71f-9b7b-41c9-8f55-35c6cbb73e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:44.050443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1053/2139] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:43 2022] DELETE /identity/v3/projects/5ed98dbe006941a9b948b5e61ba751dc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:44.053307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226e8d-b1c3-4943-b3e5-cc5e42dfec85 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.054358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226e8d-b1c3-4943-b3e5-cc5e42dfec85 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.054358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226e8d-b1c3-4943-b3e5-cc5e42dfec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.074032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1c226e8d-b1c3-4943-b3e5-cc5e42dfec85 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:44.075564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1c226e8d-b1c3-4943-b3e5-cc5e42dfec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:44.136635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1087/2140] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:44.145614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf608d-9775-4f0d-9e8f-c96585ed3522 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.145943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf608d-9775-4f0d-9e8f-c96585ed3522 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.146214 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf608d-9775-4f0d-9e8f-c96585ed3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.167976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-10cf608d-9775-4f0d-9e8f-c96585ed3522 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:44.169202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-10cf608d-9775-4f0d-9e8f-c96585ed3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:44.177735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1054/2141] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:44.181675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226e8d-b1c3-4943-b3e5-cc5e42dfec85 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.192527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226e8d-b1c3-4943-b3e5-cc5e42dfec85 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.197390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.198058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.198371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.198650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.199376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:44.199679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.201285 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.214374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1088/2142] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:44.219004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf608d-9775-4f0d-9e8f-c96585ed3522 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.228941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf608d-9775-4f0d-9e8f-c96585ed3522 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.234041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.234769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.235054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.235358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.236073 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.238066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.281054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1055/2143] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:44.281662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.301381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941766f3-0824-4c9d-af9d-a0067760fa0f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.420284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.421105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.421618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.422005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.422854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.425042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.457851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1089/2144] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:44.461558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.476531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263420b6-54d3-4069-99af-156a5bc6508b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.481575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.482311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.483094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.483381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.484156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.485915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.500064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1056/2145] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:44.503822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.515300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56391-bb7f-4bf4-9bd0-21343ac4a228 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.521512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7713-98be-4f53-ab37-8620df011d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.523533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7713-98be-4f53-ab37-8620df011d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.523533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7713-98be-4f53-ab37-8620df011d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.523533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7713-98be-4f53-ab37-8620df011d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.524176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7713-98be-4f53-ab37-8620df011d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.525968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7713-98be-4f53-ab37-8620df011d7c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.544152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1090/2146] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:44.545601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.559947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54569cd6-2431-43d7-969f-a25ee8d4ad90 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.565550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.566730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.567088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.567437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] PATH_INFO: `/v3/projects/5be8d4eb55ac48f9a65c032e04e644fd/users/5a3b56dcac48427897b8493332f15f94/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.586668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be8d4eb55ac48f9a65c032e04e644fd, user_id=5a3b56dcac48427897b8493332f15f94, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.589300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.609507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1057/2147] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:44 2022] PUT /identity/v3/projects/5be8d4eb55ac48f9a65c032e04e644fd/users/5a3b56dcac48427897b8493332f15f94/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:44.621477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4854-bca0-4285-b57e-ae5350b32790 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.621882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4854-bca0-4285-b57e-ae5350b32790 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.622057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4854-bca0-4285-b57e-ae5350b32790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.643119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:44.654967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f9fc4854-bca0-4285-b57e-ae5350b32790 None None] MFA Rules not processed for user `5a3b56dcac48427897b8493332f15f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:44.656669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9fc4854-bca0-4285-b57e-ae5350b32790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:44.746839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1091/2148] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:44.751995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.837084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ba3-7402-48f8-9ac0-77c367a1313f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.844458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.845134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.845417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.845690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.846434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.848613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.888768 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1058/2149] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:44.893713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4854-bca0-4285-b57e-ae5350b32790 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.918253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4854-bca0-4285-b57e-ae5350b32790 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.028985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.029871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.030683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.030980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.031793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.033851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.065891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1092/2150] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:45.070611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.082339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2aae-6d00-49b3-9158-4f3f13d83f6d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.088797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.089762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.089762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.090026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.090805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.092432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.110859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.111678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1059/2151] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:45.125348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2bca7-92e3-4d63-9a84-1868715fab77 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.139069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.139927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.140237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.140515 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] PATH_INFO: `/v3/projects/9b7e41bc76ec4b64b3c8d8e93aa4dfd5/users/4d4a4cd4c0404beeafc1d1e46e1249d3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.170938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7e41bc76ec4b64b3c8d8e93aa4dfd5, user_id=4d4a4cd4c0404beeafc1d1e46e1249d3, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.176681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.201255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1093/2152] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:45 2022] PUT /identity/v3/projects/9b7e41bc76ec4b64b3c8d8e93aa4dfd5/users/4d4a4cd4c0404beeafc1d1e46e1249d3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:45.204726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.211583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.216933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebee09-d84c-4bb5-9d28-fbfd9965651b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.286489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b98a87-2629-48d5-9f52-0648a474893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.287173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b98a87-2629-48d5-9f52-0648a474893d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.287589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b98a87-2629-48d5-9f52-0648a474893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.287868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b98a87-2629-48d5-9f52-0648a474893d admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.288595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b98a87-2629-48d5-9f52-0648a474893d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.291497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b98a87-2629-48d5-9f52-0648a474893d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.309907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1060/2153] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:45.314936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.328801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa49c-7002-4659-ac1b-e156ff8e4475 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.335237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.336468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.336826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.337175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] PATH_INFO: `/v3/projects/9b7e41bc76ec4b64b3c8d8e93aa4dfd5/users/4d4a4cd4c0404beeafc1d1e46e1249d3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.340546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7e41bc76ec4b64b3c8d8e93aa4dfd5, user_id=4d4a4cd4c0404beeafc1d1e46e1249d3, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.344711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.358567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1094/2154] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:45 2022] PUT /identity/v3/projects/9b7e41bc76ec4b64b3c8d8e93aa4dfd5/users/4d4a4cd4c0404beeafc1d1e46e1249d3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:45.371892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7c3b7-05c3-4709-ae9c-20a850334577 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.372187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7c3b7-05c3-4709-ae9c-20a850334577 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.372478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7c3b7-05c3-4709-ae9c-20a850334577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.416661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d0d7c3b7-05c3-4709-ae9c-20a850334577 None None] MFA Rules not processed for user `4d4a4cd4c0404beeafc1d1e46e1249d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:45.418476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d0d7c3b7-05c3-4709-ae9c-20a850334577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:45.506389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1061/2155] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:45.514273 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.516487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:45.594627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceace1-a7af-40f4-a8b9-12354c1ad35d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.600851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73968a-e4b9-4e9a-9ad0-f470f68c6a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.601614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73968a-e4b9-4e9a-9ad0-f470f68c6a89 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.601968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73968a-e4b9-4e9a-9ad0-f470f68c6a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.602348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73968a-e4b9-4e9a-9ad0-f470f68c6a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.612752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.618302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73968a-e4b9-4e9a-9ad0-f470f68c6a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.619917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73968a-e4b9-4e9a-9ad0-f470f68c6a89 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.634423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1095/2156] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:45.741388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7c3b7-05c3-4709-ae9c-20a850334577 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.756205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7c3b7-05c3-4709-ae9c-20a850334577 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.763355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.764770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.765065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.765347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.865743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.867335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.878094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1062/2157] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:46.957727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c240f-6ee5-41a9-8fda-d07b3cc697ef None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:46.958746 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c240f-6ee5-41a9-8fda-d07b3cc697ef None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:46.959196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c240f-6ee5-41a9-8fda-d07b3cc697ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.002322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e74c240f-6ee5-41a9-8fda-d07b3cc697ef None None] MFA Rules not processed for user `b3729f6d1d97450c88bc3004a70d88f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:47.003673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e74c240f-6ee5-41a9-8fda-d07b3cc697ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:47.079678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1096/2158] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:47.092360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.093834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:47.124635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.165432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587ef7-3f24-472e-bc93-892b912a5746 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.173360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.174050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.174373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.174661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.176657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:47.255849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.257327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.267197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1063/2159] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:47.427260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.427558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.427837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.446447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:47.447711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:47.514497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1097/2160] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:47.559049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.560544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:47.641188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34241c-6a79-4eb5-97c3-a223290bcbad service glance] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.648219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1ca5b-d2bd-43f8-815b-571b18c7ab8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.648890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ca5b-d2bd-43f8-815b-571b18c7ab8b service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.649180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ca5b-d2bd-43f8-815b-571b18c7ab8b service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.649464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ca5b-d2bd-43f8-815b-571b18c7ab8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.657886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1ca5b-d2bd-43f8-815b-571b18c7ab8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.659592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1ca5b-d2bd-43f8-815b-571b18c7ab8b service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.667795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1064/2161] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:03:51.665411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:51.666978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:51.870987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40b506-64e7-41a7-874a-2cbdc961beac None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:51.882703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:51.888055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:51.888333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:51.888663 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] PATH_INFO: `/v3/users/5132171268ad44b1bf5821ed85849539` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:51.890325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5132171268ad44b1bf5821ed85849539)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:51.893117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:51.995788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:52.052810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5132171268ad44b1bf5821ed85849539'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:52.065939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5132171268ad44b1bf5821ed85849539'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:52.095327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5132171268ad44b1bf5821ed85849539'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:52.131830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5132171268ad44b1bf5821ed85849539'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:52.133005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5132171268ad44b1bf5821ed85849539'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:52.149736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1098/2162] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:51 2022] DELETE /identity/v3/users/5132171268ad44b1bf5821ed85849539 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:52.152500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.153029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.153121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.181628 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:52.183930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:52.276532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1065/2163] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:52.287019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:52.288593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:52.416489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfac23-50af-43fe-bc74-6ad3c2217b37 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:52.420593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:52.421374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.421762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.422174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.432841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:52.434799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:52.446241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1099/2164] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:03:52.939908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:52.947778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:52.972557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5ba9-c1dd-4a8f-b093-607399e6296f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:52.980555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:52.981879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.982417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.983124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] PATH_INFO: `/v3/projects/9508a7f689df421f8defccb251e6c508` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.984676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9508a7f689df421f8defccb251e6c508)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:52.987650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:52.989786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:53.055957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9508a7f689df421f8defccb251e6c508', 'request_id': 'req-2968cb66-3f48-475c-8db9-d57894ce60b9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.062735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9508a7f689df421f8defccb251e6c508', 'request_id': 'req-2968cb66-3f48-475c-8db9-d57894ce60b9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.073572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9508a7f689df421f8defccb251e6c508', 'request_id': 'req-2968cb66-3f48-475c-8db9-d57894ce60b9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.085191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] The token cache is being invalidate because project 9508a7f689df421f8defccb251e6c508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:53.085546 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.086272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.088264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1066/2165] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:52 2022] DELETE /identity/v3/projects/9508a7f689df421f8defccb251e6c508 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:53.092317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:53.105359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047f9c-6373-4779-a3df-288be38bc0cc service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:53.194958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:53.195970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.196330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.197203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] PATH_INFO: `/v3/users/f9280ea5eccc445ba1843ea3cd27cace` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.199129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9280ea5eccc445ba1843ea3cd27cace)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:53.202467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:53.242181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:53.245018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:53.281197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968cb66-3f48-475c-8db9-d57894ce60b9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:53.296568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:53.303259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.304733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.305210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] PATH_INFO: `/v3/users/5a3b56dcac48427897b8493332f15f94` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.309454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3b56dcac48427897b8493332f15f94)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:53.312409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:53.322964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9280ea5eccc445ba1843ea3cd27cace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.324625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:53.344437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9280ea5eccc445ba1843ea3cd27cace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.359109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9280ea5eccc445ba1843ea3cd27cace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.382464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9280ea5eccc445ba1843ea3cd27cace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.385432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8525bb3b-3159-43a0-84af-49e68e7c7fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9280ea5eccc445ba1843ea3cd27cace'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.398742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1100/2166] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:53 2022] DELETE /identity/v3/users/f9280ea5eccc445ba1843ea3cd27cace => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:53.411027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3b56dcac48427897b8493332f15f94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.421263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3b56dcac48427897b8493332f15f94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.444586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3b56dcac48427897b8493332f15f94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.485607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3b56dcac48427897b8493332f15f94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.487013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3b56dcac48427897b8493332f15f94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.500704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1067/2167] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:53 2022] DELETE /identity/v3/users/5a3b56dcac48427897b8493332f15f94 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:53.505398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.505695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.505975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.546849 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:53.548498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:53.693376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1101/2168] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:53.706081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:53.708587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:53.752648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:53.754393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:53.772062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb866-d8bc-46db-8da1-fed5f00a6299 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:53.785330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:53.787127 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.787418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.788339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] PATH_INFO: `/v3/users/a7a6708049d24deda287408781bcebe3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.791803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a6708049d24deda287408781bcebe3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:53.796722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bc880-5ea7-45d1-ac21-175f63e79b98 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:53.797807 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:53.800606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764adf32-1850-4249-b396-1d80298958dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:53.801468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adf32-1850-4249-b396-1d80298958dc service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.801784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adf32-1850-4249-b396-1d80298958dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.802256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adf32-1850-4249-b396-1d80298958dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.818942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764adf32-1850-4249-b396-1d80298958dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:53.833584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764adf32-1850-4249-b396-1d80298958dc service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:53.853363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1068/2169] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:53.926350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a6708049d24deda287408781bcebe3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.935047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a6708049d24deda287408781bcebe3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.949367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a6708049d24deda287408781bcebe3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.967494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a6708049d24deda287408781bcebe3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.968319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a6708049d24deda287408781bcebe3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:53.983020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1102/2170] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:53 2022] DELETE /identity/v3/users/a7a6708049d24deda287408781bcebe3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:53.984397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.984687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.984966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.995372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:54.017500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:54.019239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:54.126453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1069/2171] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:03:54.127589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:54.129128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:54.193601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:54.215494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aca23c-e63d-4396-a227-b2d5f35754d5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:54.224742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:54.225553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:54.225909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:54.226323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:54.237528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:54.241608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:54.255259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1103/2172] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:54.380463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:54.382795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:54.412188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333c24b-63b4-4ca3-922e-71c279f9c652 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:54.432115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:54.433190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:54.433563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:54.433763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] PATH_INFO: `/v3/projects/711794aab0bf438a9fc8b50311b69c13` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:54.435374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711794aab0bf438a9fc8b50311b69c13)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:54.454130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:54.554422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711794aab0bf438a9fc8b50311b69c13', 'request_id': 'req-8c5f13f4-306d-4406-a490-7875d281e4d5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.565802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711794aab0bf438a9fc8b50311b69c13', 'request_id': 'req-8c5f13f4-306d-4406-a490-7875d281e4d5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.584713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711794aab0bf438a9fc8b50311b69c13', 'request_id': 'req-8c5f13f4-306d-4406-a490-7875d281e4d5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.595417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:54.596935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:54.608060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] The token cache is being invalidate because project 711794aab0bf438a9fc8b50311b69c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:54.608362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.609393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8c5f13f4-306d-4406-a490-7875d281e4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.612232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1070/2173] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:54 2022] DELETE /identity/v3/projects/711794aab0bf438a9fc8b50311b69c13 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:54.616370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838b111-dfd5-493c-9393-09675302fe76 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:54.621913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:54.622944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:54.623229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:54.649479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:54.651596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:54.715940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:54.718631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:54.720095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:54.720587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] PATH_INFO: `/v3/users/8635705162e04b8fae768d98c5c672c2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:54.722688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8635705162e04b8fae768d98c5c672c2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:54.729266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:54.803888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1071/2174] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:54.805469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:54.807685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:54.822813 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab699835-0f2c-4c7f-bde6-deb272b65c3e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:54.833639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:54.835015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:54.835506 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:54.835948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] PATH_INFO: `/v3/projects/5be8d4eb55ac48f9a65c032e04e644fd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:54.838033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be8d4eb55ac48f9a65c032e04e644fd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:54.841227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:54.870966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8635705162e04b8fae768d98c5c672c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.876764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:54.888099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8635705162e04b8fae768d98c5c672c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.904650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8635705162e04b8fae768d98c5c672c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.929058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8635705162e04b8fae768d98c5c672c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.930259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be8d4eb55ac48f9a65c032e04e644fd', 'request_id': 'req-09179224-84df-41bd-bb82-540f7117a586'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.930400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8635705162e04b8fae768d98c5c672c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.937605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1104/2175] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:54 2022] DELETE /identity/v3/users/8635705162e04b8fae768d98c5c672c2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:54.938780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:54.939129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be8d4eb55ac48f9a65c032e04e644fd', 'request_id': 'req-09179224-84df-41bd-bb82-540f7117a586'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.948853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:54.955906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be8d4eb55ac48f9a65c032e04e644fd', 'request_id': 'req-09179224-84df-41bd-bb82-540f7117a586'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.984911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] The token cache is being invalidate because project 5be8d4eb55ac48f9a65c032e04e644fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:54.987428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.988215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09179224-84df-41bd-bb82-540f7117a586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:54.996199 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1072/2176] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:54 2022] DELETE /identity/v3/projects/5be8d4eb55ac48f9a65c032e04e644fd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:55.002831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.003171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.003459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.040095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:55.041341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.104501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c376c1a-866c-4bd3-b3cb-1d5e7f5414b7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.114681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.116306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.116862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.117286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] PATH_INFO: `/v3/projects/af75b3bad7894bc5a7458da28a4406b0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.130387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=af75b3bad7894bc5a7458da28a4406b0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.135738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.140546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.262572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1073/2177] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:55.263662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.266335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.290787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af75b3bad7894bc5a7458da28a4406b0', 'request_id': 'req-0cc848a4-c93e-4618-b17b-39290cf824ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.309022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba847741-ed1b-4eb6-83f9-7a92758cd1a3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.310939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af75b3bad7894bc5a7458da28a4406b0', 'request_id': 'req-0cc848a4-c93e-4618-b17b-39290cf824ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.354087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af75b3bad7894bc5a7458da28a4406b0', 'request_id': 'req-0cc848a4-c93e-4618-b17b-39290cf824ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.406814 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] The token cache is being invalidate because project af75b3bad7894bc5a7458da28a4406b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:55.407707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.415024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.434205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1105/2178] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:54 2022] DELETE /identity/v3/projects/af75b3bad7894bc5a7458da28a4406b0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:55.435169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.436825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.515992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.518425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.518425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.518702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] PATH_INFO: `/v3/users/4d4a4cd4c0404beeafc1d1e46e1249d3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.520451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4a4cd4c0404beeafc1d1e46e1249d3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.523780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.533979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc848a4-c93e-4618-b17b-39290cf824ca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.539366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e23c-12b5-412b-ac0d-a488c0591cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.540175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e23c-12b5-412b-ac0d-a488c0591cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.540626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e23c-12b5-412b-ac0d-a488c0591cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.541022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e23c-12b5-412b-ac0d-a488c0591cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.541922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e23c-12b5-412b-ac0d-a488c0591cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:55.542307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e23c-12b5-412b-ac0d-a488c0591cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.544037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e23c-12b5-412b-ac0d-a488c0591cf5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.559162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1106/2179] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:55.562662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd55be-4584-4cb6-8fa3-9c7f11614f3a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.562662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd55be-4584-4cb6-8fa3-9c7f11614f3a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.562662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd55be-4584-4cb6-8fa3-9c7f11614f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.597662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c6fd55be-4584-4cb6-8fa3-9c7f11614f3a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:55.599947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c6fd55be-4584-4cb6-8fa3-9c7f11614f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.602812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4a4cd4c0404beeafc1d1e46e1249d3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.611769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.616484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4a4cd4c0404beeafc1d1e46e1249d3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.623526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1107/2180] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:55.623526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd55be-4584-4cb6-8fa3-9c7f11614f3a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.639327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd55be-4584-4cb6-8fa3-9c7f11614f3a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.640956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4a4cd4c0404beeafc1d1e46e1249d3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.646023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.647049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.647551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.648010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.649484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.651768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.659000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4a4cd4c0404beeafc1d1e46e1249d3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.661896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-19524b78-b197-41ce-bcd1-b28787d1b169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4a4cd4c0404beeafc1d1e46e1249d3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:55.670367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1074/2181] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:03:55 2022] DELETE /identity/v3/users/4d4a4cd4c0404beeafc1d1e46e1249d3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:55.672495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.672811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.673087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.711859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:55.713953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.720665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1108/2182] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:55 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:55.724806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.727673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.842549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1075/2183] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:55.843701 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.845043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.861615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a3c5-ff38-4b69-8248-a3e10153b7c5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.887288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.895970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84669-68fe-4c8b-98a8-fefe4f45adec admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.905610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.906346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.906633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.907383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.908099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.910742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.946251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1109/2184] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:55 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:55.946251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.958593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071fde8-b9e0-48e5-8ddf-033c1a83e6ef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.965238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.966614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.967014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.967675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.969459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:55.970039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.972653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.987822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.988912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.989200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.989475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] PATH_INFO: `/v3/projects/4dd12390001445ba8e59d21bd11b34f4` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.994188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1110/2185] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:55.994376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd12390001445ba8e59d21bd11b34f4)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.994475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.994583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.009036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be341f22-9f77-4289-9ca8-eba4949605f6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.029256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.030376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.030662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.030940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.031710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.034143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.046317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1111/2186] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:56.047334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.060054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05dfb-f941-4dd4-91f5-5ada47844f89 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.072940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd12390001445ba8e59d21bd11b34f4', 'request_id': 'req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.080731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd12390001445ba8e59d21bd11b34f4', 'request_id': 'req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.100762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd12390001445ba8e59d21bd11b34f4', 'request_id': 'req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.122748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] The token cache is being invalidate because project 4dd12390001445ba8e59d21bd11b34f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:56.123392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.124271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.126169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1076/2187] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:55 2022] DELETE /identity/v3/projects/4dd12390001445ba8e59d21bd11b34f4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:56.127434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.129878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.141258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.161480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.162310 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.162609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.162953 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.163665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.165623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.207370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1112/2188] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:56.208172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.209946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.252123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43ed5-f412-4f02-963e-11cb6c9f1b52 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.318774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711be5-c78a-43d4-8b57-365d05f8d2ad admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.332567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.333986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.334302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.334575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] PATH_INFO: `/v3/projects/9b7e41bc76ec4b64b3c8d8e93aa4dfd5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.335798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7e41bc76ec4b64b3c8d8e93aa4dfd5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.337866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.347014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cbd2e-d506-4fc8-9c5f-bf02892ddc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.348249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cbd2e-d506-4fc8-9c5f-bf02892ddc4d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.348977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cbd2e-d506-4fc8-9c5f-bf02892ddc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.349301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cbd2e-d506-4fc8-9c5f-bf02892ddc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.350038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cbd2e-d506-4fc8-9c5f-bf02892ddc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.351792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cbd2e-d506-4fc8-9c5f-bf02892ddc4d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.364908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1077/2189] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:56.366497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.366787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.367120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.388385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:56.389667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.409339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.411109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7e41bc76ec4b64b3c8d8e93aa4dfd5', 'request_id': 'req-8b06879d-df37-4bd6-8c7c-673ce648d3da'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.419591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7e41bc76ec4b64b3c8d8e93aa4dfd5', 'request_id': 'req-8b06879d-df37-4bd6-8c7c-673ce648d3da'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.433407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7e41bc76ec4b64b3c8d8e93aa4dfd5', 'request_id': 'req-8b06879d-df37-4bd6-8c7c-673ce648d3da'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.450429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] The token cache is being invalidate because project 9b7e41bc76ec4b64b3c8d8e93aa4dfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:03:56.450798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.451835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:03:56.455068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1113/2190] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:03:56 2022] DELETE /identity/v3/projects/9b7e41bc76ec4b64b3c8d8e93aa4dfd5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:56.455883 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.459840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.487827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1078/2191] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:56.500567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.503079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.535751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9cfa-4e8e-486b-8d73-a671f7247ad7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.551603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f170-83d4-4111-8aa7-9b0c40c83f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.552725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f170-83d4-4111-8aa7-9b0c40c83f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.553078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f170-83d4-4111-8aa7-9b0c40c83f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.553456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f170-83d4-4111-8aa7-9b0c40c83f02 admin admin] PATH_INFO: `/v3/projects/9b04780bf02a47d791a688b79eda9eb2/users/94f560ad2a1442b19dae037a7adef7c5/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.565962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06879d-df37-4bd6-8c7c-673ce648d3da admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.572399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d16c0d-9d72-4b90-b7a5-964dcb37f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.573589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16c0d-9d72-4b90-b7a5-964dcb37f905 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.574432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16c0d-9d72-4b90-b7a5-964dcb37f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.574866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16c0d-9d72-4b90-b7a5-964dcb37f905 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.575713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d16c0d-9d72-4b90-b7a5-964dcb37f905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.578377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d16c0d-9d72-4b90-b7a5-964dcb37f905 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.579563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f170-83d4-4111-8aa7-9b0c40c83f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b04780bf02a47d791a688b79eda9eb2, user_id=94f560ad2a1442b19dae037a7adef7c5, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.584145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f170-83d4-4111-8aa7-9b0c40c83f02 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.622523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1079/2192] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:56 2022] PUT /identity/v3/projects/9b04780bf02a47d791a688b79eda9eb2/users/94f560ad2a1442b19dae037a7adef7c5/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:56.624521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568361bb-ff7d-4243-8d70-d54cab453fa5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.624521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568361bb-ff7d-4243-8d70-d54cab453fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.625152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568361bb-ff7d-4243-8d70-d54cab453fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.632197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1114/2193] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:56.634039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe0ad-46c8-4b11-bf19-8f5014c0aa6d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.634535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe0ad-46c8-4b11-bf19-8f5014c0aa6d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.635781 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe0ad-46c8-4b11-bf19-8f5014c0aa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.653923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-568361bb-ff7d-4243-8d70-d54cab453fa5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:56.655592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-568361bb-ff7d-4243-8d70-d54cab453fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.661745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-984fe0ad-46c8-4b11-bf19-8f5014c0aa6d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:56.663274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-984fe0ad-46c8-4b11-bf19-8f5014c0aa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.699103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.751698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1115/2194] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:56.756606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe0ad-46c8-4b11-bf19-8f5014c0aa6d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.768264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe0ad-46c8-4b11-bf19-8f5014c0aa6d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.773818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.774932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.775385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.775999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.776898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.779099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.789541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1080/2195] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:56.791837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3190-f6c2-4f93-8484-ba927c68871c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.792186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3190-f6c2-4f93-8484-ba927c68871c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.792469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3190-f6c2-4f93-8484-ba927c68871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.795525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1116/2196] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:56.796697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.809782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee28c-fc0f-4ff9-90f1-6d6e80a729c7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.815895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec9645-8c47-42b8-a930-a18456010fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.817574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec9645-8c47-42b8-a930-a18456010fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.817799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec9645-8c47-42b8-a930-a18456010fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.818079 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec9645-8c47-42b8-a930-a18456010fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.819000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec9645-8c47-42b8-a930-a18456010fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:56.819451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec9645-8c47-42b8-a930-a18456010fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.821089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec9645-8c47-42b8-a930-a18456010fa9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.833186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fe5b3190-f6c2-4f93-8484-ba927c68871c None None] MFA Rules not processed for user `94f560ad2a1442b19dae037a7adef7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:56.836277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fe5b3190-f6c2-4f93-8484-ba927c68871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.838508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1117/2197] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:56.841351 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330556-08df-44ca-bfe0-98470ac8b521 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.841659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330556-08df-44ca-bfe0-98470ac8b521 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.842016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330556-08df-44ca-bfe0-98470ac8b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.868350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21330556-08df-44ca-bfe0-98470ac8b521 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:56.870245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21330556-08df-44ca-bfe0-98470ac8b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.886895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1118/2198] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:56.887825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330556-08df-44ca-bfe0-98470ac8b521 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.903461 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330556-08df-44ca-bfe0-98470ac8b521 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.910129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.911029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.911445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.911726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.912455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.914070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.930816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1119/2199] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:56.930816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.945495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6387140-2821-45e6-a8d6-170388308fdc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.950670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.952355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.953074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.953074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.953744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.955832 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.970876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1081/2200] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:56.972007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3190-f6c2-4f93-8484-ba927c68871c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.992198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1120/2201] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:56.993018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.997204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3190-f6c2-4f93-8484-ba927c68871c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.999111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:57.093329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.094313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.095038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.095517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.096581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:57.097048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.100573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.108799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679ba67-fb04-4955-a3f4-12d3d1dfc47f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.114747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.115743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.116034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.116358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] PATH_INFO: `/v3/projects/48f07b65840749278c57086f334b1464/users/020b5f4f54454db69bdaad6bae01792f/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.118401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1082/2202] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:57.120943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.123322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:57.136062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f07b65840749278c57086f334b1464, user_id=020b5f4f54454db69bdaad6bae01792f, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.145625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.172294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1121/2203] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:56 2022] PUT /identity/v3/projects/48f07b65840749278c57086f334b1464/users/020b5f4f54454db69bdaad6bae01792f/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:57.174429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.221838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:57.233272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b10c7-d4bd-4c0c-b74c-312839dcfc08 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.312598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c61ff9-9a9e-41d5-a18c-e3de633a0a14 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.326657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.327826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.327826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.328027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.330367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.335836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.355991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f2a0a-5d50-49b8-91e4-521677941d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.356755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f2a0a-5d50-49b8-91e4-521677941d05 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.357126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f2a0a-5d50-49b8-91e4-521677941d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.357485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f2a0a-5d50-49b8-91e4-521677941d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.373889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1122/2204] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:57 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:57.374988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.390888 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43148a7a-7484-4c9e-9d4e-ef2408847748 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.399674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.400759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.401327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.401799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.402795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.409837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.425074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f2a0a-5d50-49b8-91e4-521677941d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.426712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f2a0a-5d50-49b8-91e4-521677941d05 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.437216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1083/2205] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:57.438485 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea9fe-8f41-4f65-af40-6622720e7c64 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.438791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea9fe-8f41-4f65-af40-6622720e7c64 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.439087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea9fe-8f41-4f65-af40-6622720e7c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.477356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1123/2206] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:57 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:57.477933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.483239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-208ea9fe-8f41-4f65-af40-6622720e7c64 None None] MFA Rules not processed for user `020b5f4f54454db69bdaad6bae01792f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:57.484736 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-208ea9fe-8f41-4f65-af40-6622720e7c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:57.600518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:57.617099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c37c4-7f5e-47e3-b1bb-9cd54c8f5c9e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.628636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1084/2207] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:57.629703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea9fe-8f41-4f65-af40-6622720e7c64 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.635695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.636708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.637140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.637520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.639865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.642007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.652478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea9fe-8f41-4f65-af40-6622720e7c64 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.660304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1124/2208] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:57.661829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.668482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.670264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.670655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.671043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.671638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.673610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.682175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77dea-9420-4af9-9f8a-d5cfd4febe20 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.691498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.692317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.692894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.693230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.693972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.696218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.713076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1085/2209] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:57 2022] POST /identity/v3/users => generated 284 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:57.714253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.740408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae38fa-61e5-49fd-8d5f-39097a0847b3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.745007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1125/2210] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:57 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:57.751138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.754089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.756222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.756559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.756851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.759754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.761461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.790598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1086/2211] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:57.791459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.815302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faabc8-3c39-40f9-ab65-e37b9b6120db admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.838331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13070-4a93-41d7-980c-8111f35aaf32 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.844221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:57.845270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.846178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.846603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.846963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.847952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.850167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.863528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1126/2212] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:57.864684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.879874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25df89-414d-4c6e-8688-c8a245ace1e5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.886491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.887818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.888180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.888534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] PATH_INFO: `/v3/projects/357f0d847515459b88535cca16b1ded0/users/23afc43b8ace4666897be821328afd50/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.929893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63372c2e-a019-4dd7-a70d-2ad35bafc575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.929893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63372c2e-a019-4dd7-a70d-2ad35bafc575 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.929893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63372c2e-a019-4dd7-a70d-2ad35bafc575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.929893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63372c2e-a019-4dd7-a70d-2ad35bafc575 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.930720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63372c2e-a019-4dd7-a70d-2ad35bafc575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.932570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63372c2e-a019-4dd7-a70d-2ad35bafc575 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.934933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=357f0d847515459b88535cca16b1ded0, user_id=23afc43b8ace4666897be821328afd50, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.938881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.959600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1127/2213] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:57 2022] PUT /identity/v3/projects/357f0d847515459b88535cca16b1ded0/users/23afc43b8ace4666897be821328afd50/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:57.961007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.989265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1087/2214] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:57 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:57.992049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de155c-53f9-454a-862a-fd2540be0cb0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.992193 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de155c-53f9-454a-862a-fd2540be0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.993851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de155c-53f9-454a-862a-fd2540be0cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.051081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-06de155c-53f9-454a-862a-fd2540be0cb0 None None] MFA Rules not processed for user `23afc43b8ace4666897be821328afd50`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:58.052395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-06de155c-53f9-454a-862a-fd2540be0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:58.093596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa429e-53ac-458c-8e91-78ddd4e6e08a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.102667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.103466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.103842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.104214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.105078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.107328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.122416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1128/2215] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:58.122416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.136590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32085dcb-ba9d-4f2c-bc8b-f1eba6ada855 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.142597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.142788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1088/2216] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:58.146396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.146396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.146605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de155c-53f9-454a-862a-fd2540be0cb0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.146691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.146691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.147491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.160368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de155c-53f9-454a-862a-fd2540be0cb0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.163899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1129/2217] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:58.164897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.168980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.170151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.170791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.171387 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] PATH_INFO: `/v3/projects/81a3937a710d41d0b1f414b752f76d3d/users/ee76b679074144499c57d9f21158c236/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.181535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa3fa9-3774-4722-8a93-e256d80df076 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.187358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.188348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.188640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.188968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.189683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.192064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.205557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a3937a710d41d0b1f414b752f76d3d, user_id=ee76b679074144499c57d9f21158c236, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.211130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.231882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1130/2218] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/projects => generated 403 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:58.231882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.238600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1089/2219] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:58 2022] PUT /identity/v3/projects/81a3937a710d41d0b1f414b752f76d3d/users/ee76b679074144499c57d9f21158c236/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:58.240478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.243721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:58.362361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05808097-acee-4c69-ac41-8f4d5f3377ca admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.368512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cf940-95a1-401f-8000-7f504e216b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.369521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cf940-95a1-401f-8000-7f504e216b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.369875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cf940-95a1-401f-8000-7f504e216b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.370290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cf940-95a1-401f-8000-7f504e216b8e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.371382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cf940-95a1-401f-8000-7f504e216b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.375229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cf940-95a1-401f-8000-7f504e216b8e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.378139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721030-5f11-40c4-bd5b-a96b4ead3c28 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.391710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.391710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.391710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.391710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.392186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.393701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.412074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1090/2220] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/users => generated 308 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:58.415965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1131/2221] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:58.417707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.420139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c055314-49f3-4337-8806-d6d58c008596 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.420444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c055314-49f3-4337-8806-d6d58c008596 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.420879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c055314-49f3-4337-8806-d6d58c008596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.429016 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:58.436278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf113cd-527b-4ef7-9ce6-70ae866586f3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.451323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.454184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.454774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.455300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.456266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.459417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.473384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9c055314-49f3-4337-8806-d6d58c008596 None None] MFA Rules not processed for user `ee76b679074144499c57d9f21158c236`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:58.476040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9c055314-49f3-4337-8806-d6d58c008596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:58.478825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1132/2222] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:58.480175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.498167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272436b2-84e7-4a0e-a087-6aecf93faced admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.510889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.512755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.513281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.514664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] PATH_INFO: `/v3/projects/3fd2fb04c42b499da4e14b4642c8edbf/users/ef274c3249284d5aa7f55daa93151b51/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.553949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd2fb04c42b499da4e14b4642c8edbf, user_id=ef274c3249284d5aa7f55daa93151b51, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.557643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.571942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1091/2223] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:58.572829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c055314-49f3-4337-8806-d6d58c008596 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.591868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c055314-49f3-4337-8806-d6d58c008596 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.594848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1133/2224] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:58 2022] PUT /identity/v3/projects/3fd2fb04c42b499da4e14b4642c8edbf/users/ef274c3249284d5aa7f55daa93151b51/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:58.597024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.730656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f973dce-b2ff-4736-9626-7b4b2212c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.731858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f973dce-b2ff-4736-9626-7b4b2212c449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.732192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f973dce-b2ff-4736-9626-7b4b2212c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.733393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f973dce-b2ff-4736-9626-7b4b2212c449 admin admin] PATH_INFO: `/v3/projects/73fe4b795488414786522606a378d2da/users/f216b81def284efaa81955e8a8466502/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.739884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bba8d-d8a0-43b5-b919-1e9d6787badf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.746395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.747082 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.747362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.747643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.749397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.751635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.752118 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f973dce-b2ff-4736-9626-7b4b2212c449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fe4b795488414786522606a378d2da, user_id=f216b81def284efaa81955e8a8466502, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.756208 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f973dce-b2ff-4736-9626-7b4b2212c449 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.778021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1092/2225] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:58 2022] PUT /identity/v3/projects/73fe4b795488414786522606a378d2da/users/f216b81def284efaa81955e8a8466502/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:58.779829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda76204-a911-415c-82ab-ec2e21c4a1f2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.780213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda76204-a911-415c-82ab-ec2e21c4a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.780585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda76204-a911-415c-82ab-ec2e21c4a1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.808122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1134/2226] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:58.810572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.821883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fda76204-a911-415c-82ab-ec2e21c4a1f2 None None] MFA Rules not processed for user `ef274c3249284d5aa7f55daa93151b51`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:58.823012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fda76204-a911-415c-82ab-ec2e21c4a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:58.917542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:58.936660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1093/2227] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:58.937612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda76204-a911-415c-82ab-ec2e21c4a1f2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.939433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f78f5-3b66-43cb-990e-0938ab3b1692 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.944981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:58.949827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda76204-a911-415c-82ab-ec2e21c4a1f2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:58.959179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.960070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.960425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.960777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.961599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.964532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.965852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:58.966930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.967727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.968716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.969575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:58.973178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:58.979692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1135/2228] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:58.981188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.997565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b997378-38ca-495e-8fe0-5af22036eff5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.006021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.007055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.007167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1094/2229] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/users => generated 290 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:59.007969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.010029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.010459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.011239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.013282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.019711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021adc-0bc8-4075-a36d-a1f5e4c9d351 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.026513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.027679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.028385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.028904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] PATH_INFO: `/v3/projects/73fe4b795488414786522606a378d2da/users/f216b81def284efaa81955e8a8466502/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.033677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fe4b795488414786522606a378d2da, user_id=f216b81def284efaa81955e8a8466502, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.037964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.060947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1095/2230] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:59 2022] PUT /identity/v3/projects/73fe4b795488414786522606a378d2da/users/f216b81def284efaa81955e8a8466502/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:59.061211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1136/2231] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:59.062058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.066080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.161862 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ef2b8-f00e-4fda-ac09-5a41f610386c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.168028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.169227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.169675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.170146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.171156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.171338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efba8b-8af5-4332-9da8-5a47776dce9e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.173759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.176664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31404cbe-587e-498e-ada2-6e44ec31464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.177427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404cbe-587e-498e-ada2-6e44ec31464c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.177766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404cbe-587e-498e-ada2-6e44ec31464c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.178101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404cbe-587e-498e-ada2-6e44ec31464c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.178921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31404cbe-587e-498e-ada2-6e44ec31464c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.180594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31404cbe-587e-498e-ada2-6e44ec31464c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.195769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1137/2232] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:59.197557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077a93-eb21-47cf-9575-db3ee0b6e757 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.197845 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077a93-eb21-47cf-9575-db3ee0b6e757 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.198135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077a93-eb21-47cf-9575-db3ee0b6e757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.209329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1096/2233] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:03:59 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:59.210497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.223687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838c443-023f-4b32-958f-c5897d21cb2f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.231864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.233704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.234268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.234787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] PATH_INFO: `/v3/projects/fe9a1bbb0abb43d98c743a9b44cc8b65/users/1620911bc7ca4aaa90011d2c571f7d58/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.255537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9a1bbb0abb43d98c743a9b44cc8b65, user_id=1620911bc7ca4aaa90011d2c571f7d58, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.259038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.260358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-82077a93-eb21-47cf-9575-db3ee0b6e757 None None] MFA Rules not processed for user `f216b81def284efaa81955e8a8466502`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:59.262029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-82077a93-eb21-47cf-9575-db3ee0b6e757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:59.279398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1097/2234] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:59 2022] PUT /identity/v3/projects/fe9a1bbb0abb43d98c743a9b44cc8b65/users/1620911bc7ca4aaa90011d2c571f7d58/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:59.280269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.376662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1138/2235] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:59.377705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82077a93-eb21-47cf-9575-db3ee0b6e757 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.402894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82077a93-eb21-47cf-9575-db3ee0b6e757 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.408072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692b4e0-d182-4457-8479-6f310f0d2e89 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.408902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.413649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.414281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.414567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.414863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.415597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.417130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.417311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.417861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.418556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.420254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.422664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.429851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1098/2236] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:59.431529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.444659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1139/2237] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:59.446771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.462631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241351-5dc5-4906-960b-9a7b9764bb86 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.471510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.472994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.473576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.474175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] PATH_INFO: `/v3/projects/844e01f4bd3d4418ae65633ffe983db1/users/33e57f7704df480eadf0eacc0bb31b5b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.480263 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:59.500027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844e01f4bd3d4418ae65633ffe983db1, user_id=33e57f7704df480eadf0eacc0bb31b5b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.502857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e76a6-1a47-43ee-8e2b-3ce8ee0bae82 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.503374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.511444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.512160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.512452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.512780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.526524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1140/2238] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:59 2022] PUT /identity/v3/projects/844e01f4bd3d4418ae65633ffe983db1/users/33e57f7704df480eadf0eacc0bb31b5b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:59.528190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.543279 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:59.649635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.652534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.664057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1099/2239] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:03:59.664968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.690872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2df46-92ba-497f-8d92-1bd524896e9e service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.698070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.698916 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.699301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.699692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.700694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.702534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.706685 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64a17-2615-499e-8bb2-2cadac613731 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.748344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1100/2240] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:59.749038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19836aa-88ea-4870-8654-19e2b84d7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.749038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19836aa-88ea-4870-8654-19e2b84d7fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.749038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19836aa-88ea-4870-8654-19e2b84d7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.749038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19836aa-88ea-4870-8654-19e2b84d7fb0 admin admin] PATH_INFO: `/v3/projects/fe9a1bbb0abb43d98c743a9b44cc8b65/users/1620911bc7ca4aaa90011d2c571f7d58/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.753441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.755064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19836aa-88ea-4870-8654-19e2b84d7fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9a1bbb0abb43d98c743a9b44cc8b65, user_id=1620911bc7ca4aaa90011d2c571f7d58, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.761404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19836aa-88ea-4870-8654-19e2b84d7fb0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.781006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e458b0e-4447-4a48-80ed-6e0487e8ea39 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.799607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1141/2241] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:59 2022] PUT /identity/v3/projects/fe9a1bbb0abb43d98c743a9b44cc8b65/users/1620911bc7ca4aaa90011d2c571f7d58/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:59.801490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59c87-8b32-40dc-bf4c-fef9b92b63ac None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.801895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59c87-8b32-40dc-bf4c-fef9b92b63ac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.802315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59c87-8b32-40dc-bf4c-fef9b92b63ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.855716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c7f59c87-8b32-40dc-bf4c-fef9b92b63ac None None] MFA Rules not processed for user `1620911bc7ca4aaa90011d2c571f7d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:59.857162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c7f59c87-8b32-40dc-bf4c-fef9b92b63ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:59.887322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674daa-99ee-48da-b0bb-494dec254576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.888264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674daa-99ee-48da-b0bb-494dec254576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.888548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674daa-99ee-48da-b0bb-494dec254576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.888825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674daa-99ee-48da-b0bb-494dec254576 admin admin] PATH_INFO: `/v3/projects/844e01f4bd3d4418ae65633ffe983db1/users/33e57f7704df480eadf0eacc0bb31b5b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.891039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674daa-99ee-48da-b0bb-494dec254576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844e01f4bd3d4418ae65633ffe983db1, user_id=33e57f7704df480eadf0eacc0bb31b5b, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.894555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674daa-99ee-48da-b0bb-494dec254576 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.906148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1101/2242] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:03:59 2022] PUT /identity/v3/projects/844e01f4bd3d4418ae65633ffe983db1/users/33e57f7704df480eadf0eacc0bb31b5b/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:59.916984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab3d8-54ec-4bf7-949b-870dd476a13d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.917380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab3d8-54ec-4bf7-949b-870dd476a13d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.917869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab3d8-54ec-4bf7-949b-870dd476a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.947279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-92bab3d8-54ec-4bf7-949b-870dd476a13d None None] MFA Rules not processed for user `33e57f7704df480eadf0eacc0bb31b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:59.948458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1142/2243] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:03:59.948603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-92bab3d8-54ec-4bf7-949b-870dd476a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:59.960182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59c87-8b32-40dc-bf4c-fef9b92b63ac None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.036521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59c87-8b32-40dc-bf4c-fef9b92b63ac None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.043600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.075721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1102/2244] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:00.099392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.111514 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fdd68-1c2b-4bf2-ab3f-e2b340f1aef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.114571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fdd68-1c2b-4bf2-ab3f-e2b340f1aef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.115215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fdd68-1c2b-4bf2-ab3f-e2b340f1aef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.115787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fdd68-1c2b-4bf2-ab3f-e2b340f1aef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.211627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fdd68-1c2b-4bf2-ab3f-e2b340f1aef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.213134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fdd68-1c2b-4bf2-ab3f-e2b340f1aef7 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.225771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1143/2245] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:04:00.275388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab3d8-54ec-4bf7-949b-870dd476a13d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.286676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab3d8-54ec-4bf7-949b-870dd476a13d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.290592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.291250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.291537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.291819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.373633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.375254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.400145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1103/2246] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:00.591915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599c57-27ec-41de-805d-bac76f6b54b0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.592206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599c57-27ec-41de-805d-bac76f6b54b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.592516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599c57-27ec-41de-805d-bac76f6b54b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.611304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ae599c57-27ec-41de-805d-bac76f6b54b0 None None] MFA Rules not processed for user `94dbfb6cf680454f883d43796f05c799`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:00.612616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae599c57-27ec-41de-805d-bac76f6b54b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:00.658964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.668829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86416b59-4f02-405f-994f-6be43686405f service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.672742 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1144/2247] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:00.674133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a06bb-5b90-41a6-a9e9-f0eda64e542e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.674925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a06bb-5b90-41a6-a9e9-f0eda64e542e service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.675196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a06bb-5b90-41a6-a9e9-f0eda64e542e service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.675658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a06bb-5b90-41a6-a9e9-f0eda64e542e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.747279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a06bb-5b90-41a6-a9e9-f0eda64e542e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.749010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a06bb-5b90-41a6-a9e9-f0eda64e542e service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.760142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1104/2248] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:01.290565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae599c57-27ec-41de-805d-bac76f6b54b0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.378305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae599c57-27ec-41de-805d-bac76f6b54b0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.383667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:01.384619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.384967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.385323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] PATH_INFO: `/v3/users/23afc43b8ace4666897be821328afd50` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.392635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23afc43b8ace4666897be821328afd50)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:01.394921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:01.444405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:01.450424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23afc43b8ace4666897be821328afd50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:01.458717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23afc43b8ace4666897be821328afd50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:01.468083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23afc43b8ace4666897be821328afd50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:01.482151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23afc43b8ace4666897be821328afd50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:01.483175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23afc43b8ace4666897be821328afd50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:01.489315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1145/2249] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:01 2022] DELETE /identity/v3/users/23afc43b8ace4666897be821328afd50 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:01.493845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.494286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.494579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.511731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:01.512938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:01.584808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1105/2250] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:01.595437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.597136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:01.662387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94307a-f335-4eb3-b718-dff816e6e298 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.666019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:01.666703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.666990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.667267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.677161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:01.678732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:01.688295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1146/2251] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:01.980057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.981517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:01.994411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f28d42-5d95-47e8-be59-1b3de345aa96 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.999555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.000549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.000936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.001310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] PATH_INFO: `/v3/projects/357f0d847515459b88535cca16b1ded0` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.003417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] RBAC: Authorizing `identity:delete_project(project_id=357f0d847515459b88535cca16b1ded0)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.005440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:02.041741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:02.064278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357f0d847515459b88535cca16b1ded0', 'request_id': 'req-13253f13-36f7-45e2-80bb-cf029c5b979e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.071424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357f0d847515459b88535cca16b1ded0', 'request_id': 'req-13253f13-36f7-45e2-80bb-cf029c5b979e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.082423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357f0d847515459b88535cca16b1ded0', 'request_id': 'req-13253f13-36f7-45e2-80bb-cf029c5b979e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.095467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] The token cache is being invalidate because project 357f0d847515459b88535cca16b1ded0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:02.095765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.096456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.101693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1106/2252] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:01 2022] DELETE /identity/v3/projects/357f0d847515459b88535cca16b1ded0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:02.103018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:02.138224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce755-6410-4b55-a30e-466d41658380 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:02.197197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.198251 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.198535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.198811 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] PATH_INFO: `/v3/users/f216b81def284efaa81955e8a8466502` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.200128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f216b81def284efaa81955e8a8466502)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.202044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:02.251224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f216b81def284efaa81955e8a8466502'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.258889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f216b81def284efaa81955e8a8466502'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.268567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f216b81def284efaa81955e8a8466502'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.269784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:02.282913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f216b81def284efaa81955e8a8466502'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.283610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c0efe7b1-59e6-4b5a-9143-9cb245266041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f216b81def284efaa81955e8a8466502'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.289747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1147/2253] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:02 2022] DELETE /identity/v3/users/f216b81def284efaa81955e8a8466502 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:04:02.613613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:02.615394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:02.628869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253f13-36f7-45e2-80bb-cf029c5b979e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:02.695577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.696870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.697192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.697501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] PATH_INFO: `/v3/projects/73fe4b795488414786522606a378d2da` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.699103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fe4b795488414786522606a378d2da)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.701291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:02.756350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fe4b795488414786522606a378d2da', 'request_id': 'req-e556dd6f-1a14-4509-9e25-e7a20719c134'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.764252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fe4b795488414786522606a378d2da', 'request_id': 'req-e556dd6f-1a14-4509-9e25-e7a20719c134'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.775574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fe4b795488414786522606a378d2da', 'request_id': 'req-e556dd6f-1a14-4509-9e25-e7a20719c134'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.787751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] The token cache is being invalidate because project 73fe4b795488414786522606a378d2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:02.788057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.788652 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e556dd6f-1a14-4509-9e25-e7a20719c134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:02.790302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1107/2254] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:02 2022] DELETE /identity/v3/projects/73fe4b795488414786522606a378d2da => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:02.795352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f136fa-e974-4c34-bf62-6c6fb694ba16 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.795828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f136fa-e974-4c34-bf62-6c6fb694ba16 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.795935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f136fa-e974-4c34-bf62-6c6fb694ba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.814657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-70f136fa-e974-4c34-bf62-6c6fb694ba16 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:02.815879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-70f136fa-e974-4c34-bf62-6c6fb694ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:02.881775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1148/2255] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:02.889855 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581072f-334d-4912-9cb1-140ab7ced856 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.890138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581072f-334d-4912-9cb1-140ab7ced856 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.890445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581072f-334d-4912-9cb1-140ab7ced856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.910568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8581072f-334d-4912-9cb1-140ab7ced856 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:02.911804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8581072f-334d-4912-9cb1-140ab7ced856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:02.920495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1108/2256] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:02.924791 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f136fa-e974-4c34-bf62-6c6fb694ba16 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:02.934843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f136fa-e974-4c34-bf62-6c6fb694ba16 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:02.939678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.940340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.940626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.940904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.941732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:02.942083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.943847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:02.956410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1149/2257] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:02.960944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581072f-334d-4912-9cb1-140ab7ced856 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:02.970847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581072f-334d-4912-9cb1-140ab7ced856 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:02.976303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.976966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.977257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.977539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.978275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.980203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.010324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1109/2258] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:02 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:03.014648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.025256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b41f8-cf83-4e83-a690-17d376b33307 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.082520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.083385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.083667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.083948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.084629 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.086603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.109276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1150/2259] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:03 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:03.113572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.124066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a62d-1bec-47ba-b3ac-bf1a143a8efc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.128955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.129781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.130067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.130377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.131111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.132734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.143296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1110/2260] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:04:03.149412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.160115 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8029-cd61-4d91-adde-87341225ea55 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.165192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5b873-b4a0-4f8d-89a7-6d139f27c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.165991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b873-b4a0-4f8d-89a7-6d139f27c1df admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.166372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b873-b4a0-4f8d-89a7-6d139f27c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.166711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b873-b4a0-4f8d-89a7-6d139f27c1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.167512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5b873-b4a0-4f8d-89a7-6d139f27c1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.169218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5b873-b4a0-4f8d-89a7-6d139f27c1df admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.181934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1151/2261] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:03.189979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.203030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:03.207429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535f23-fa20-4d02-83d2-681a68e0f49c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.217842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.218788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.219528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.220537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] PATH_INFO: `/v3/projects/c8a3a8cf339b4d1da1cfb791d873fd1f/users/0437d5cb5c1a49479502dec92c902d14/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.237700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a3a8cf339b4d1da1cfb791d873fd1f, user_id=0437d5cb5c1a49479502dec92c902d14, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.240756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.263997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1111/2262] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:03 2022] PUT /identity/v3/projects/c8a3a8cf339b4d1da1cfb791d873fd1f/users/0437d5cb5c1a49479502dec92c902d14/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:03.274541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58006293-f694-4f5d-92b7-3b1706276763 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.274909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58006293-f694-4f5d-92b7-3b1706276763 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.275199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58006293-f694-4f5d-92b7-3b1706276763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.303130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-58006293-f694-4f5d-92b7-3b1706276763 None None] MFA Rules not processed for user `0437d5cb5c1a49479502dec92c902d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:03.304347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-58006293-f694-4f5d-92b7-3b1706276763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:03.343398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:03.379507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1152/2263] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:03.386175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.455034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d36e7-5ed3-4f9e-8a03-5971f7ad4e85 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.460705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.461443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.461789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.462142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.462999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.464945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.499239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1112/2264] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:03 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:03.500379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58006293-f694-4f5d-92b7-3b1706276763 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.512176 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58006293-f694-4f5d-92b7-3b1706276763 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.572087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.572770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.573061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.573343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.574059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.576034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.597092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1153/2265] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:03 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:04:03.601343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.612507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bda99-2828-449b-bd6c-8cf94cceb923 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.618282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.618953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.619238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.619513 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.620247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.621934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.633973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1113/2266] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:03.638379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.649432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31dcfc-b318-4fe7-9d13-20aca498b5b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.654407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.655335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.655651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.655931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] PATH_INFO: `/v3/projects/c7172f2e84134805bfb7f632fcd11191/users/04a973d21e8f40fdb2db988bce39ba1e/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.672414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7172f2e84134805bfb7f632fcd11191, user_id=04a973d21e8f40fdb2db988bce39ba1e, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.675194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.690303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1154/2267] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:03 2022] PUT /identity/v3/projects/c7172f2e84134805bfb7f632fcd11191/users/04a973d21e8f40fdb2db988bce39ba1e/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:03.694495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.704976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5246685-3f2e-4df1-b60e-eb63c8197568 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.762763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf72fa7-6e09-4bf7-a3b0-74b1a22e203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.763544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72fa7-6e09-4bf7-a3b0-74b1a22e203f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.763875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72fa7-6e09-4bf7-a3b0-74b1a22e203f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.764311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72fa7-6e09-4bf7-a3b0-74b1a22e203f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.765049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf72fa7-6e09-4bf7-a3b0-74b1a22e203f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.766688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf72fa7-6e09-4bf7-a3b0-74b1a22e203f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.779778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1114/2268] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:03.781692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.793035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd5ff0-2202-4ed7-bf66-40a904f4fd33 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.797988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.798906 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.799193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.799470 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] PATH_INFO: `/v3/projects/c7172f2e84134805bfb7f632fcd11191/users/04a973d21e8f40fdb2db988bce39ba1e/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.801520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7172f2e84134805bfb7f632fcd11191, user_id=04a973d21e8f40fdb2db988bce39ba1e, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.804180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.814707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1155/2269] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:03 2022] PUT /identity/v3/projects/c7172f2e84134805bfb7f632fcd11191/users/04a973d21e8f40fdb2db988bce39ba1e/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:03.826133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.826444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.826726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.853276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] MFA Rules not processed for user `04a973d21e8f40fdb2db988bce39ba1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:03.854451 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:03.895724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:03.927435 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1115/2270] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:03.938970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.941050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:04.011808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd4b65-337f-4e96-8e34-54e1b7dbde93 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:04.016025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:04.016688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.016975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.017250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.027247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:04.028720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:04.038293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1156/2271] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:04.113260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:04.118965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:04.127996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94886-931f-4089-b9f0-49fda96857c8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:04.132006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3e17-4851-46a4-83c6-bd05e8848501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:04.132651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3e17-4851-46a4-83c6-bd05e8848501 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.132931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3e17-4851-46a4-83c6-bd05e8848501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.133215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3e17-4851-46a4-83c6-bd05e8848501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.192026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3e17-4851-46a4-83c6-bd05e8848501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:04.193453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3e17-4851-46a4-83c6-bd05e8848501 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:04.205082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1116/2272] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:09.724591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:09.733805 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a19e5-8c4f-46ba-9521-975ff853cbe8 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:09.738090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:09.738315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:09.738582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:09.738789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:09.740851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:09.775247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:09.811526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:09.813244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:09.823916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1157/2273] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:09.872342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833fce-c4f8-4ded-a291-209c44ca1d12 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:09.873099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833fce-c4f8-4ded-a291-209c44ca1d12 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:09.873412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833fce-c4f8-4ded-a291-209c44ca1d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:09.903091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-17833fce-c4f8-4ded-a291-209c44ca1d12 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:09.904325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-17833fce-c4f8-4ded-a291-209c44ca1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:10.003194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1117/2274] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:04:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:10.024554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:10.026092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:10.118422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616a668-06f9-4a28-aa91-60880843a8d3 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:10.126040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:10.126924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:10.127401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:10.127833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:10.148658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:10.151123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:10.161717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1158/2275] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:04:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:04:13.181141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17833fce-c4f8-4ded-a291-209c44ca1d12 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:13.190648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17833fce-c4f8-4ded-a291-209c44ca1d12 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:13.194682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cf801-b205-4188-aba8-86adde812bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:13.195335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf801-b205-4188-aba8-86adde812bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:13.195667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf801-b205-4188-aba8-86adde812bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:13.196062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf801-b205-4188-aba8-86adde812bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:13.197997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7e9cf801-b205-4188-aba8-86adde812bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:13.268796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cf801-b205-4188-aba8-86adde812bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:13.270301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cf801-b205-4188-aba8-86adde812bcd service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:13.280719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1118/2276] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:20.157343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=46 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:23.276043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:25.204621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:25.206330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:25.325843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cc7ae-41a7-49ca-9849-1209ecf88ff0 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:25.334003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:25.335215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:25.335443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:25.335817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] PATH_INFO: `/v3/users/ee76b679074144499c57d9f21158c236` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:25.337206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee76b679074144499c57d9f21158c236)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:25.348021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:25.465915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee76b679074144499c57d9f21158c236'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:25.485273 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee76b679074144499c57d9f21158c236'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:25.508011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee76b679074144499c57d9f21158c236'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:25.539401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee76b679074144499c57d9f21158c236'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:25.541024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee76b679074144499c57d9f21158c236'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:25.548078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1159/2277] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:25 2022] DELETE /identity/v3/users/ee76b679074144499c57d9f21158c236 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:25.552924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:25.553383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:25.553668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:25.574829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:25.576151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:25.661627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1119/2278] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:25.673030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:25.675256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:25.749432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122470a8-f6b5-4caa-9d03-d0cec7752068 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:25.763668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:25.767343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:25.767634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:25.767926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:25.791362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:25.792881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:25.842786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1160/2279] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:26.064644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:26.066165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:26.094837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea73a6-ea54-4fa4-9997-e365c661bf80 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:26.101113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:26.102835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:26.104078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:26.104554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] PATH_INFO: `/v3/users/cd2295b8a3834b0286192511047218a1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:26.109377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2295b8a3834b0286192511047218a1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:26.113306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:26.194464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2295b8a3834b0286192511047218a1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.204334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2295b8a3834b0286192511047218a1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.227159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2295b8a3834b0286192511047218a1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.252268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2295b8a3834b0286192511047218a1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.253467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-11cec5d3-4b6c-49f7-b230-8e0953674d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2295b8a3834b0286192511047218a1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.255768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:26.257472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:26.262341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1120/2280] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:26 2022] DELETE /identity/v3/users/cd2295b8a3834b0286192511047218a1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:26.267074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:26.267537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:26.267981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:26.272769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9e6e3-b2b0-48fa-8028-dd876a22505f service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:26.291069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:26.292645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:26.323996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:26.411259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:26.412233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:26.412475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:26.412757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] PATH_INFO: `/v3/projects/81a3937a710d41d0b1f414b752f76d3d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:26.415292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a3937a710d41d0b1f414b752f76d3d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:26.422573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:26.442368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1121/2281] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:26.459492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:26.461311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:26.499419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:26.528319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a3937a710d41d0b1f414b752f76d3d', 'request_id': 'req-54f9d345-d51a-4c3b-aed0-0db68fe994fb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.564611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a3937a710d41d0b1f414b752f76d3d', 'request_id': 'req-54f9d345-d51a-4c3b-aed0-0db68fe994fb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.569596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5528-a373-40d0-8f84-50b2cc9b376d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:26.595287 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a3937a710d41d0b1f414b752f76d3d', 'request_id': 'req-54f9d345-d51a-4c3b-aed0-0db68fe994fb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.641943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] The token cache is being invalidate because project 81a3937a710d41d0b1f414b752f76d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:26.642280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.647944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.654189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1161/2282] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:26 2022] DELETE /identity/v3/projects/81a3937a710d41d0b1f414b752f76d3d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:04:26.657357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:26.670015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:26.730841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:26.732000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:26.732560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:26.733653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:26.746632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:26.781884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9d345-d51a-4c3b-aed0-0db68fe994fb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:26.787421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:26.788497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:26.788822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:26.789261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] PATH_INFO: `/v3/users/1620911bc7ca4aaa90011d2c571f7d58` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:26.790513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1620911bc7ca4aaa90011d2c571f7d58)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:26.792501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:26.841050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:26.842592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:26.853977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1122/2283] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:04:26.870738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1620911bc7ca4aaa90011d2c571f7d58'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.885621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:26.890989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1620911bc7ca4aaa90011d2c571f7d58'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.906740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1620911bc7ca4aaa90011d2c571f7d58'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.950960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1620911bc7ca4aaa90011d2c571f7d58'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.958313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1620911bc7ca4aaa90011d2c571f7d58'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:26.965634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1162/2284] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:26 2022] DELETE /identity/v3/users/1620911bc7ca4aaa90011d2c571f7d58 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:27.536060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:27.537694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:27.669260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a12705-28d4-4eb6-ae3b-30c9d30a1db3 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:27.691140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:27.699738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:27.701212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:27.756487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:27.757477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:27.758008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:27.758403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] PATH_INFO: `/v3/projects/4eec872b230445749a112223130ed647` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:27.759808 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eec872b230445749a112223130ed647)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:27.761997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:27.826586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eec872b230445749a112223130ed647', 'request_id': 'req-d9a8e5b2-f43b-4a1e-a590-510a574e914e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.834527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eec872b230445749a112223130ed647', 'request_id': 'req-d9a8e5b2-f43b-4a1e-a590-510a574e914e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.839110 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3984f-6a66-46f9-b26f-6a94876411c1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:27.845733 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eec872b230445749a112223130ed647', 'request_id': 'req-d9a8e5b2-f43b-4a1e-a590-510a574e914e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.859459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] The token cache is being invalidate because project 4eec872b230445749a112223130ed647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:27.859752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.860555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.862507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1123/2285] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:27 2022] DELETE /identity/v3/projects/4eec872b230445749a112223130ed647 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:27.863041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:27.864324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:27.905040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:27.905928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:27.906259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:27.906544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] PATH_INFO: `/v3/users/0437d5cb5c1a49479502dec92c902d14` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:27.907757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0437d5cb5c1a49479502dec92c902d14)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:27.909752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:27.928903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8e5b2-f43b-4a1e-a590-510a574e914e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:27.933873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:27.934788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:27.935076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:27.935357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] PATH_INFO: `/v3/projects/fe9a1bbb0abb43d98c743a9b44cc8b65` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:27.936562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9a1bbb0abb43d98c743a9b44cc8b65)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:27.938556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:27.957305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0437d5cb5c1a49479502dec92c902d14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.958526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:27.965437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0437d5cb5c1a49479502dec92c902d14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.975308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0437d5cb5c1a49479502dec92c902d14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.988369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9a1bbb0abb43d98c743a9b44cc8b65', 'request_id': 'req-998c058f-9213-45f2-9997-a6afab2ed66d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.988813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0437d5cb5c1a49479502dec92c902d14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.989537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f6575305-ce2a-4725-9600-db4f3b2f1aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0437d5cb5c1a49479502dec92c902d14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.989658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:27.996391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9a1bbb0abb43d98c743a9b44cc8b65', 'request_id': 'req-998c058f-9213-45f2-9997-a6afab2ed66d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:27.996856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1163/2286] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:27 2022] DELETE /identity/v3/users/0437d5cb5c1a49479502dec92c902d14 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:27.998386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af954d8-8ee6-4ed7-9721-da7f1edd03c3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:27.998659 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af954d8-8ee6-4ed7-9721-da7f1edd03c3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:27.998937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af954d8-8ee6-4ed7-9721-da7f1edd03c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.009007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9a1bbb0abb43d98c743a9b44cc8b65', 'request_id': 'req-998c058f-9213-45f2-9997-a6afab2ed66d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.021476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] The token cache is being invalidate because project fe9a1bbb0abb43d98c743a9b44cc8b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:28.021795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.022488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-998c058f-9213-45f2-9997-a6afab2ed66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.025127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1124/2287] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:27 2022] DELETE /identity/v3/projects/fe9a1bbb0abb43d98c743a9b44cc8b65 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:28.026352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f81ad-9b04-4974-b880-f4edb3973654 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.026642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f81ad-9b04-4974-b880-f4edb3973654 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.026929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f81ad-9b04-4974-b880-f4edb3973654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.049798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8af954d8-8ee6-4ed7-9721-da7f1edd03c3 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:28.051070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8af954d8-8ee6-4ed7-9721-da7f1edd03c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.052363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ac1f81ad-9b04-4974-b880-f4edb3973654 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:28.053548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ac1f81ad-9b04-4974-b880-f4edb3973654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.114035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1164/2288] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:28.115368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.115486 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1125/2289] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:28.115655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.115932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.121797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8418998-af10-41bb-a4df-57c23b4c0a6d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.122375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8418998-af10-41bb-a4df-57c23b4c0a6d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.123184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8418998-af10-41bb-a4df-57c23b4c0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.135855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:28.137081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.142882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f8418998-af10-41bb-a4df-57c23b4c0a6d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:28.144060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f8418998-af10-41bb-a4df-57c23b4c0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.145218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1165/2290] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:28.146058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.147336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.153297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1126/2291] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:28.156660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce9a85-ed3b-4f8b-a7b9-050cbb3f1a66 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.156660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce9a85-ed3b-4f8b-a7b9-050cbb3f1a66 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.156660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce9a85-ed3b-4f8b-a7b9-050cbb3f1a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.173610 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d3ce9a85-ed3b-4f8b-a7b9-050cbb3f1a66 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:28.175023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d3ce9a85-ed3b-4f8b-a7b9-050cbb3f1a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.187001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1127/2292] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:28.187001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce9a85-ed3b-4f8b-a7b9-050cbb3f1a66 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.200537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce9a85-ed3b-4f8b-a7b9-050cbb3f1a66 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.204570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.205725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.206060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.206618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.207543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:28.208046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.209860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.228117 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1128/2293] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:28.228117 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.239822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bf222-9626-48fc-bcec-95eeeecf381b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.244529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.245319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.245463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.245740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.246827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:28.247094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.248856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.254092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79f888-cd80-43d1-9dd0-1ed14bda5397 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.257881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.258569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.259016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.259296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.261801 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1129/2294] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:28.262686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.272277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.272726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f3952-477d-4d57-8aa9-8ae8c98e0f2b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.273734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.277665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.278223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.278508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.278787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.279474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.281347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.283908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1166/2295] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:28.284901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.290560 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.300083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.304160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46d687-e041-4eb6-b5c0-2eef702f4245 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.310235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.311721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.312356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.315704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1130/2296] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:28.315704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.315950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] PATH_INFO: `/v3/users/020b5f4f54454db69bdaad6bae01792f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.317020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=020b5f4f54454db69bdaad6bae01792f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.319767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.382167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020b5f4f54454db69bdaad6bae01792f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.391408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020b5f4f54454db69bdaad6bae01792f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.393556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430d1b-9148-44c5-9440-13351c845e49 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.399682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b33838-75c9-4b12-861c-d6e39015b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.400534 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33838-75c9-4b12-861c-d6e39015b1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.400956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33838-75c9-4b12-861c-d6e39015b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.401240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33838-75c9-4b12-861c-d6e39015b1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.401479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020b5f4f54454db69bdaad6bae01792f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.402218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b33838-75c9-4b12-861c-d6e39015b1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.404382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b33838-75c9-4b12-861c-d6e39015b1d2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.417373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020b5f4f54454db69bdaad6bae01792f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.418103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020b5f4f54454db69bdaad6bae01792f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.420411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.427450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1167/2297] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:28 2022] DELETE /identity/v3/users/020b5f4f54454db69bdaad6bae01792f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:28.428467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.432196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.440748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1131/2298] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:28.443744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.443744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.443744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.470080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:28.473691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.531274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920032f-6256-461c-99e2-2cfe97266dec admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.581611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1132/2299] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:28.581611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.582267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.597096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329950-eb75-426f-ad18-bd1e941416d5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.603395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.604053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.604364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.604763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.606400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.608862 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.642970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1133/2300] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:28.642970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.645046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.666961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.668233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.668605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.668899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.669606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.671631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.693481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1168/2301] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:28 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:28.694382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.695974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.708149 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e45d1-a6ce-4fda-adee-b38671997ab9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.712958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.713922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.714304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.714648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] PATH_INFO: `/v3/projects/c8a3a8cf339b4d1da1cfb791d873fd1f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.715930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a3a8cf339b4d1da1cfb791d873fd1f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.717172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8047246-66a5-4fee-bf8d-a6822dd97a6b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.718074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.720909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.721555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.721842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.722137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.727077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.732347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.735064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.745213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1134/2302] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:28.748502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.759298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44e49-3fff-49c3-9a46-328fd07e3467 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.774850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a3a8cf339b4d1da1cfb791d873fd1f', 'request_id': 'req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.782989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a3a8cf339b4d1da1cfb791d873fd1f', 'request_id': 'req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.793223 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a3a8cf339b4d1da1cfb791d873fd1f', 'request_id': 'req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.810194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] The token cache is being invalidate because project c8a3a8cf339b4d1da1cfb791d873fd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:28.810588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.811344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.813654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1169/2303] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:28 2022] DELETE /identity/v3/projects/c8a3a8cf339b4d1da1cfb791d873fd1f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:28.814355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.815733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.833899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.834892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.835358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.835786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.836684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.838394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.849358 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1135/2304] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:28.850173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.851910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.865066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e77bfc-590e-47dc-835f-faf375a27670 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.870805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.871681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.871966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.872238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] PATH_INFO: `/v3/users/04a973d21e8f40fdb2db988bce39ba1e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.873461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a973d21e8f40fdb2db988bce39ba1e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.875449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.890818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.902828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2646-b8f1-4c1e-ab60-42ace6a7fe39 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.908447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.909396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.909396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.909655 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.910417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.912859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.928607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1170/2305] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:28.929296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.935532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:28.944825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a973d21e8f40fdb2db988bce39ba1e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.954258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578dff-d0ce-4681-9297-643b9011f499 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.955257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a973d21e8f40fdb2db988bce39ba1e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.960789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.961932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.961932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.962229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.962927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.964756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.968067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a973d21e8f40fdb2db988bce39ba1e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.976205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1171/2306] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:28.976949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.988146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bd303-da37-4362-b0d6-cdddf8f88f09 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.990446 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a973d21e8f40fdb2db988bce39ba1e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.991168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a973d21e8f40fdb2db988bce39ba1e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:28.993416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.994331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.994691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.995043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.995853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.997545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.000893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1136/2307] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:28 2022] DELETE /identity/v3/users/04a973d21e8f40fdb2db988bce39ba1e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:29.000893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.002065 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.009463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1172/2308] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:29.012911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.014835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.034612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fde8c-ca42-45c5-a8b2-6af56389d990 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.105439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fc46-6364-4067-a806-b78a5cb73e35 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.115879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.117253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.117593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.117941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] PATH_INFO: `/v3/projects/6cfdaf44728a47799d94e741583123a9/users/025fea018f5a410ea6fd6232f4195bf2/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.135543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798e4d5-571f-42ac-9f55-28768fe58c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.136765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798e4d5-571f-42ac-9f55-28768fe58c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.137307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798e4d5-571f-42ac-9f55-28768fe58c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.137817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798e4d5-571f-42ac-9f55-28768fe58c35 admin admin] PATH_INFO: `/v3/projects/415cf8d1309246d0879aa26adfd2bc7b/users/647c280b8def48a48352ae1545285562/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.140165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cfdaf44728a47799d94e741583123a9, user_id=025fea018f5a410ea6fd6232f4195bf2, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.143553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.157678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798e4d5-571f-42ac-9f55-28768fe58c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415cf8d1309246d0879aa26adfd2bc7b, user_id=647c280b8def48a48352ae1545285562, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.160850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798e4d5-571f-42ac-9f55-28768fe58c35 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.181790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1137/2309] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:28 2022] PUT /identity/v3/projects/6cfdaf44728a47799d94e741583123a9/users/025fea018f5a410ea6fd6232f4195bf2/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:29.182153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:29.182268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.186293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.195473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1173/2310] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:29 2022] PUT /identity/v3/projects/415cf8d1309246d0879aa26adfd2bc7b/users/647c280b8def48a48352ae1545285562/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:29.201103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df9f6b-1730-4b61-b05b-f56ebea29c7c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.201394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df9f6b-1730-4b61-b05b-f56ebea29c7c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.201676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df9f6b-1730-4b61-b05b-f56ebea29c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.242874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b7df9f6b-1730-4b61-b05b-f56ebea29c7c None None] MFA Rules not processed for user `025fea018f5a410ea6fd6232f4195bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:29.244578 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b7df9f6b-1730-4b61-b05b-f56ebea29c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.275897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8eec2-e13a-4c6e-8a34-89440e1eb667 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.296136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:29.322006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1174/2311] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:29.323230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed87fa-a950-411b-b4cd-11eb1f4a813f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.323595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed87fa-a950-411b-b4cd-11eb1f4a813f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.323937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed87fa-a950-411b-b4cd-11eb1f4a813f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.348720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.349604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.349883 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.350187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] PATH_INFO: `/v3/projects/48f07b65840749278c57086f334b1464` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.351414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f07b65840749278c57086f334b1464)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.354329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.357757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-81ed87fa-a950-411b-b4cd-11eb1f4a813f None None] MFA Rules not processed for user `647c280b8def48a48352ae1545285562`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:29.359596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-81ed87fa-a950-411b-b4cd-11eb1f4a813f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.413450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f07b65840749278c57086f334b1464', 'request_id': 'req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.419812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f07b65840749278c57086f334b1464', 'request_id': 'req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.426853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1175/2312] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:29.427508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed87fa-a950-411b-b4cd-11eb1f4a813f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.432517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f07b65840749278c57086f334b1464', 'request_id': 'req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.439039 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed87fa-a950-411b-b4cd-11eb1f4a813f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.445615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] The token cache is being invalidate because project 48f07b65840749278c57086f334b1464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:29.445902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.446651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.448378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1138/2313] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:29 2022] DELETE /identity/v3/projects/48f07b65840749278c57086f334b1464 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:29.449135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.450477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.496653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.497320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.497605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.497878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.498619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.500525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.514623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb60f-b4a2-4a1c-8ad0-ce951a484b22 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.519873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.520867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.521218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.521491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] PATH_INFO: `/v3/projects/c7172f2e84134805bfb7f632fcd11191` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.522834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:29.522982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7172f2e84134805bfb7f632fcd11191)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.526501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.541561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1176/2314] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:29 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:29.542882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.546139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.580200 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7172f2e84134805bfb7f632fcd11191', 'request_id': 'req-d450c3af-85a4-4287-a221-745acb030d5a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.582153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:29.588170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7172f2e84134805bfb7f632fcd11191', 'request_id': 'req-d450c3af-85a4-4287-a221-745acb030d5a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.597447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7172f2e84134805bfb7f632fcd11191', 'request_id': 'req-d450c3af-85a4-4287-a221-745acb030d5a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.604590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466e539-4e3e-41ee-80ab-04c0861a5bdd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.610460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] The token cache is being invalidate because project c7172f2e84134805bfb7f632fcd11191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:29.610758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.611412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.613059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1139/2315] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:29 2022] DELETE /identity/v3/projects/c7172f2e84134805bfb7f632fcd11191 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:29.616360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.616360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.656418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.657049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.657338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.657610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.659442 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.679766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450c3af-85a4-4287-a221-745acb030d5a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.686137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.687046 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.687324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.687595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] PATH_INFO: `/v3/users/ef274c3249284d5aa7f55daa93151b51` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.689223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef274c3249284d5aa7f55daa93151b51)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.691249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.727697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.729236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.739342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1177/2316] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:29.741997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.743433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.759560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef274c3249284d5aa7f55daa93151b51'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.760360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c40e1-8b44-4518-8063-525e3ce53410 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.765935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611d55e-aa59-4cce-8e8b-3d8905e571a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.766665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611d55e-aa59-4cce-8e8b-3d8905e571a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.767005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611d55e-aa59-4cce-8e8b-3d8905e571a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.767270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611d55e-aa59-4cce-8e8b-3d8905e571a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.767966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611d55e-aa59-4cce-8e8b-3d8905e571a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.769996 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611d55e-aa59-4cce-8e8b-3d8905e571a1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.771436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef274c3249284d5aa7f55daa93151b51'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.787608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef274c3249284d5aa7f55daa93151b51'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.796896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1178/2317] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:29 2022] POST /identity/v3/users => generated 300 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:29.798534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1250ff-e615-44af-9750-bab6ea5e3eb0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.799003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1250ff-e615-44af-9750-bab6ea5e3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.799435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1250ff-e615-44af-9750-bab6ea5e3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.808779 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef274c3249284d5aa7f55daa93151b51'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.809735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef274c3249284d5aa7f55daa93151b51'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:29.817329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1140/2318] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:29 2022] DELETE /identity/v3/users/ef274c3249284d5aa7f55daa93151b51 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:29.818567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.820942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.827398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4e1250ff-e615-44af-9750-bab6ea5e3eb0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:29.828765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4e1250ff-e615-44af-9750-bab6ea5e3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.909145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:29.928978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21197f8-dd9a-4622-8727-7d3ac0d4cf8b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.930341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1179/2319] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:29.938148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d8b01-414d-46e4-af12-bbab830ce99a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.938346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d8b01-414d-46e4-af12-bbab830ce99a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.938616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d8b01-414d-46e4-af12-bbab830ce99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.940520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.941225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.941523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.942921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.944154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:29.945945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:29.949544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:29.961136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-187d8b01-414d-46e4-af12-bbab830ce99a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:29.963563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-187d8b01-414d-46e4-af12-bbab830ce99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:29.963840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1141/2320] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:29.967884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.975656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1180/2321] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:29.980743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d8b01-414d-46e4-af12-bbab830ce99a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:29.982087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287bb46-c75b-4e39-81cc-e87c865e2230 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:29.988932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:29.990427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:29.990882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:29.991309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] PATH_INFO: `/v3/projects/6117363362754eca9a6e280ea0055db5/users/95237132cd004030a331a1a574895812/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:29.992145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d8b01-414d-46e4-af12-bbab830ce99a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.000909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.000909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.000909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.000909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.001260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:30.001260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.002432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.020642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1181/2322] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:04:30.026298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.034417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6117363362754eca9a6e280ea0055db5, user_id=95237132cd004030a331a1a574895812, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.037643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.042552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f54dc-0871-4c31-abeb-8e19df483398 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.047997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.048677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.048974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.049253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.050100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.052108 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.061570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1142/2323] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:29 2022] PUT /identity/v3/projects/6117363362754eca9a6e280ea0055db5/users/95237132cd004030a331a1a574895812/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:30.062814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.094544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1182/2324] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:30 2022] POST /identity/v3/projects => generated 357 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:04:30.105937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.173152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ba61e-8415-409b-ba9a-1906a03317ec admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.205796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328235-fcf2-46d1-89c8-dfbc97372e86 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.212868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.213639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.213988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.214362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.215128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.217165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.248029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1183/2325] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:30 2022] POST /identity/v3/users => generated 279 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:30.249105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.251018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.251177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.251712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.251997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.252273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.252997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.254747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.265661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d0b1-c781-4c6e-a7c6-986f1e1b8597 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.269837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1143/2326] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:30.269837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.273772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.275024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.275379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.275754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] PATH_INFO: `/v3/projects/3fd2fb04c42b499da4e14b4642c8edbf` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.277937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd2fb04c42b499da4e14b4642c8edbf)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.280014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.280166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b8507-8368-4d70-bf80-6d682c5e6bdb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.285440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.286142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.286425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.286700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.287428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.289699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.301567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1144/2327] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:30.302445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.315321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197990b2-510a-45f3-90ab-30af9ddbd470 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.320963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.322276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.322651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.322979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] PATH_INFO: `/v3/projects/6117363362754eca9a6e280ea0055db5/users/95237132cd004030a331a1a574895812/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.325305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6117363362754eca9a6e280ea0055db5, user_id=95237132cd004030a331a1a574895812, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.328116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.340805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1145/2328] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:30 2022] PUT /identity/v3/projects/6117363362754eca9a6e280ea0055db5/users/95237132cd004030a331a1a574895812/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:30.341712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.360626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd2fb04c42b499da4e14b4642c8edbf', 'request_id': 'req-080866d0-aaf9-4d1a-bf7f-40f372da1afb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.373111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd2fb04c42b499da4e14b4642c8edbf', 'request_id': 'req-080866d0-aaf9-4d1a-bf7f-40f372da1afb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.385184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd2fb04c42b499da4e14b4642c8edbf', 'request_id': 'req-080866d0-aaf9-4d1a-bf7f-40f372da1afb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.398317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] The token cache is being invalidate because project 3fd2fb04c42b499da4e14b4642c8edbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:30.398616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.399316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-080866d0-aaf9-4d1a-bf7f-40f372da1afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.400927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1184/2329] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:30 2022] DELETE /identity/v3/projects/3fd2fb04c42b499da4e14b4642c8edbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:30.402308 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.402524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.402730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.422452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:30.428793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] MFA Rules not processed for user `95237132cd004030a331a1a574895812`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:30.430104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.435786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a159a-512d-4dd1-bb6b-dbf106c71c69 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.439704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:30.440660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.441334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.441621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.441897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.442777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.444440 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.454959 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1146/2330] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:30.455784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.457547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.470388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843be46-a642-44fb-8900-498d755ccfd8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.475114 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.475991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.476272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.476547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] PATH_INFO: `/v3/users/33e57f7704df480eadf0eacc0bb31b5b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.477919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e57f7704df480eadf0eacc0bb31b5b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.479814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.502227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1185/2331] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:30.503120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.504677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.518716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842066fd-1a50-4230-ae3a-77af5e28e11f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.523654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.524761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.525041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.525315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] PATH_INFO: `/v3/projects/fbc3c1dfb6f04b22adbff7638547b485/users/85b091d131094c41b9342eea9bc0d4d8/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.538696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e57f7704df480eadf0eacc0bb31b5b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.541225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc3c1dfb6f04b22adbff7638547b485, user_id=85b091d131094c41b9342eea9bc0d4d8, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.543860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.546643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e57f7704df480eadf0eacc0bb31b5b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.556361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e57f7704df480eadf0eacc0bb31b5b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.562045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1186/2332] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:30 2022] PUT /identity/v3/projects/fbc3c1dfb6f04b22adbff7638547b485/users/85b091d131094c41b9342eea9bc0d4d8/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:30.562961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.564533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.579882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e57f7704df480eadf0eacc0bb31b5b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.580971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4d9f759f-1f70-49e3-985b-6a8ce9cd1659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e57f7704df480eadf0eacc0bb31b5b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:30.588965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1147/2333] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:30 2022] DELETE /identity/v3/users/33e57f7704df480eadf0eacc0bb31b5b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:30.590347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.590643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.590905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.620083 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] MFA Rules not processed for user `85b091d131094c41b9342eea9bc0d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:30.621311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.625563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818042b3-4ac3-41a0-97db-d399092cd783 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.688662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.689804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.690090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.690400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.692247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.699994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1148/2334] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:30 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:30.703285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.704752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.753608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:30.769873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:30.770710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.773609 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.784727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1187/2335] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:30.790445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7b608-1c43-4f5f-93da-5a1814213095 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.795605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.796355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.796721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.797071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.797876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.799908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.830589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1149/2336] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:30 2022] POST /identity/v3/projects => generated 355 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:30.834492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.846908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88ff1-917d-4b91-a34b-6bfbe5ee080f service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:30.887710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:30.890256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:30.933457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:30.934270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:30.934552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:30.934864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:30.936362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:30.938755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:30.989224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1188/2337] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:30 2022] POST /identity/v3/users => generated 284 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:30.989713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.004725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c99a8-dcee-423c-8003-03e4d9eb83dc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.011995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.011995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.011995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.011995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.012593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.014270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.026146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488099e-fa3e-44d0-b2e6-dc8ecb2d25e0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.031900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.032991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.034259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.034765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] PATH_INFO: `/v3/projects/844e01f4bd3d4418ae65633ffe983db1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.037427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1189/2338] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:04:31.037547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844e01f4bd3d4418ae65633ffe983db1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.039348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.041656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.053229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ca052-923e-4e7b-8c84-f3537ecb94f4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.065719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.066665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.066952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.067235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] PATH_INFO: `/v3/projects/ae0ed1ab2e3e4871b3950ff69039d542/users/7ff3cd3b69e14c87b7b2466c282ea5c9/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.093312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0ed1ab2e3e4871b3950ff69039d542, user_id=7ff3cd3b69e14c87b7b2466c282ea5c9, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.096375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.104088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844e01f4bd3d4418ae65633ffe983db1', 'request_id': 'req-6bf1e241-710a-4ae2-9c68-0103cb3d4412'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.116194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844e01f4bd3d4418ae65633ffe983db1', 'request_id': 'req-6bf1e241-710a-4ae2-9c68-0103cb3d4412'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.120111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1190/2339] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:31 2022] PUT /identity/v3/projects/ae0ed1ab2e3e4871b3950ff69039d542/users/7ff3cd3b69e14c87b7b2466c282ea5c9/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:31.122846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844e01f4bd3d4418ae65633ffe983db1', 'request_id': 'req-6bf1e241-710a-4ae2-9c68-0103cb3d4412'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.124274 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.138096 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] The token cache is being invalidate because project 844e01f4bd3d4418ae65633ffe983db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:31.138505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.139172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6bf1e241-710a-4ae2-9c68-0103cb3d4412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.142206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1150/2340] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:30 2022] DELETE /identity/v3/projects/844e01f4bd3d4418ae65633ffe983db1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:31.146952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b805e-8d5b-419a-86bd-31a7ebc92448 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.147243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b805e-8d5b-419a-86bd-31a7ebc92448 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.147564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b805e-8d5b-419a-86bd-31a7ebc92448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.167543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-736b805e-8d5b-419a-86bd-31a7ebc92448 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:31.168262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-736b805e-8d5b-419a-86bd-31a7ebc92448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.214861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867400-6370-464e-8c24-b47433d02f72 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.221737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.222503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.222786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.223062 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.223784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.226652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.238238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1191/2341] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:31.242974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.245070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.247930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1151/2342] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:31.258290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61f0a-bff1-42f7-a6a5-8051a557469f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.258934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61f0a-bff1-42f7-a6a5-8051a557469f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.259407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61f0a-bff1-42f7-a6a5-8051a557469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.259929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a656-9db7-4865-bed6-7d7c191d3b52 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.264963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f74e0-8fe0-4fc5-a015-099761063bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.265863 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f74e0-8fe0-4fc5-a015-099761063bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.266182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f74e0-8fe0-4fc5-a015-099761063bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.266468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f74e0-8fe0-4fc5-a015-099761063bcb admin admin] PATH_INFO: `/v3/projects/ae0ed1ab2e3e4871b3950ff69039d542/users/7ff3cd3b69e14c87b7b2466c282ea5c9/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.269103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.269671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f74e0-8fe0-4fc5-a015-099761063bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0ed1ab2e3e4871b3950ff69039d542, user_id=7ff3cd3b69e14c87b7b2466c282ea5c9, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.273428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f74e0-8fe0-4fc5-a015-099761063bcb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.283366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-dbe61f0a-bff1-42f7-a6a5-8051a557469f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:31.285559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dbe61f0a-bff1-42f7-a6a5-8051a557469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.288784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1192/2343] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:31 2022] PUT /identity/v3/projects/ae0ed1ab2e3e4871b3950ff69039d542/users/7ff3cd3b69e14c87b7b2466c282ea5c9/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:31.299948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.300247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.300648 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.327389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] MFA Rules not processed for user `7ff3cd3b69e14c87b7b2466c282ea5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:31.328734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.345348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.352494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1152/2344] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:31.357611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe61f0a-bff1-42f7-a6a5-8051a557469f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.373385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe61f0a-bff1-42f7-a6a5-8051a557469f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.379731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.380408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.380693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.380965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.381776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:31.382089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.384284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.405563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1153/2345] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:31.411240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.424359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bfa6f-4fab-47db-9bb3-c330e797c098 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.429584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.430761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.431057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.431462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.432269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.433616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1193/2346] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:31.434555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.450881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.452508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.486192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1154/2347] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:31 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:31.487276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.531002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a0153-8d99-40dd-b6c4-1dcfc38f759d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.563271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ab725-e145-4d7a-9525-49733d188690 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.568363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.569044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.569328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.569607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.570384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.572822 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.600491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1155/2348] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:31 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:31.601391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.603919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.605422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.606091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.606415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.606703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.616171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb82ba7-9fe6-4a88-8eb5-a7dd6b8d53c9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.621942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.622984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.623332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.623662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] PATH_INFO: `/v3/users/025fea018f5a410ea6fd6232f4195bf2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.624947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025fea018f5a410ea6fd6232f4195bf2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.627047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.670956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.672418 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.678840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025fea018f5a410ea6fd6232f4195bf2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.682544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1194/2349] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:31.685077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.687379 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.687536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025fea018f5a410ea6fd6232f4195bf2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.698261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025fea018f5a410ea6fd6232f4195bf2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.700363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd32c33-a5a1-4058-aae6-9654b5cd7c6d service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.707044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dfa0-0b6f-4a2d-804f-3592ea74d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.707750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dfa0-0b6f-4a2d-804f-3592ea74d842 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.708054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dfa0-0b6f-4a2d-804f-3592ea74d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.708398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dfa0-0b6f-4a2d-804f-3592ea74d842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.709498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dfa0-0b6f-4a2d-804f-3592ea74d842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.711150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dfa0-0b6f-4a2d-804f-3592ea74d842 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.714359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025fea018f5a410ea6fd6232f4195bf2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.715071 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025fea018f5a410ea6fd6232f4195bf2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:31.722165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1195/2350] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:31.722620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1156/2351] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:31 2022] DELETE /identity/v3/users/025fea018f5a410ea6fd6232f4195bf2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:31.726544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.726838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.727005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.727118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.728740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.744394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.750891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:31.753009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.800047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93735d-a113-492a-b2dd-dc41681ddcd6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.804817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.805550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.805852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.806160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.806904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.808533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.816502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1196/2352] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:31.821666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1157/2353] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:31.821947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.822758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.823253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.832793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe4f5-e315-4d50-a9a0-f2b9ff40339d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.837948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.838865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.839154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.839432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] PATH_INFO: `/v3/projects/d79b255da8a64ac3812a913bb9d5467f/users/564db89f205644ac98a78ec971da428c/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.854339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79b255da8a64ac3812a913bb9d5467f, user_id=564db89f205644ac98a78ec971da428c, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.857037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.870879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1158/2354] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:31 2022] PUT /identity/v3/projects/d79b255da8a64ac3812a913bb9d5467f/users/564db89f205644ac98a78ec971da428c/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:31.879147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.879147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.891190 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd91e9-d794-4353-bd7d-c7c3720f91e4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.933650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d953052-1e24-4a92-8ae0-7d504275b18c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.937433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a727ea8-968e-4674-b69e-3c761e2fbb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.938095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a727ea8-968e-4674-b69e-3c761e2fbb00 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.938411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a727ea8-968e-4674-b69e-3c761e2fbb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.938690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a727ea8-968e-4674-b69e-3c761e2fbb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.940790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.941436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.941747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.942020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.943909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.997324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:32.001638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a727ea8-968e-4674-b69e-3c761e2fbb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:32.003554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a727ea8-968e-4674-b69e-3c761e2fbb00 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:32.005356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:32.006864 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:32.014420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1159/2355] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:32.015983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:32.016720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:32.016830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1197/2356] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:32.018541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:32.049977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] MFA Rules not processed for user `564db89f205644ac98a78ec971da428c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:32.051250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:32.132572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1160/2357] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:32.142097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:32.144711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:32.198063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:32.251054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25376432-5db8-4a59-832a-e96afb0772b6 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:32.256129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:32.256930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:32.257220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:32.257499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:32.268137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:32.269846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:32.283192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1198/2358] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:32.353284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:32.354836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:32.379287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaa59a-46bb-46a1-a5dd-51a18b169be9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:32.384237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:32.385145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:32.385498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:32.385775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] PATH_INFO: `/v3/projects/6cfdaf44728a47799d94e741583123a9` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:32.387031 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cfdaf44728a47799d94e741583123a9)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:32.388927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:32.449293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfdaf44728a47799d94e741583123a9', 'request_id': 'req-3b35751b-f33b-40f4-a18c-0f6495cdbebe'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.456055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfdaf44728a47799d94e741583123a9', 'request_id': 'req-3b35751b-f33b-40f4-a18c-0f6495cdbebe'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.465635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfdaf44728a47799d94e741583123a9', 'request_id': 'req-3b35751b-f33b-40f4-a18c-0f6495cdbebe'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.476452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] The token cache is being invalidate because project 6cfdaf44728a47799d94e741583123a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:32.476816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.477557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.479364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1161/2359] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:32 2022] DELETE /identity/v3/projects/6cfdaf44728a47799d94e741583123a9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:32.483994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:32.495775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89536471-4ef7-43ff-a970-5cef9ad51cfb service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:32.563575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:32.565555 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:32.566000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:32.566525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] PATH_INFO: `/v3/users/95237132cd004030a331a1a574895812` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:32.568329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95237132cd004030a331a1a574895812)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:32.570964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:32.672443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95237132cd004030a331a1a574895812'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.683748 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95237132cd004030a331a1a574895812'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.692575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95237132cd004030a331a1a574895812'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.709902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95237132cd004030a331a1a574895812'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.710841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bee5e2a5-bbf8-46db-be0a-8402f9c5eab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95237132cd004030a331a1a574895812'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:32.718586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1199/2360] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:32 2022] DELETE /identity/v3/users/95237132cd004030a331a1a574895812 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:33.077303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:33.079661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:33.093356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35751b-f33b-40f4-a18c-0f6495cdbebe admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:33.160607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:33.161759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.161989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.162388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] PATH_INFO: `/v3/projects/6117363362754eca9a6e280ea0055db5` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.163846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6117363362754eca9a6e280ea0055db5)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:33.166044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:33.191363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:33.300109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6117363362754eca9a6e280ea0055db5', 'request_id': 'req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:33.309363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6117363362754eca9a6e280ea0055db5', 'request_id': 'req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:33.320511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6117363362754eca9a6e280ea0055db5', 'request_id': 'req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:33.334825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] The token cache is being invalidate because project 6117363362754eca9a6e280ea0055db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:33.335127 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:33.335800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f34e4f6-09f1-4e3b-a7fa-a7af93bf8f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:33.337443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1162/2361] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:33 2022] DELETE /identity/v3/projects/6117363362754eca9a6e280ea0055db5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:33.343721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0111-4a31-4533-ac21-67e5bf63a128 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.344939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0111-4a31-4533-ac21-67e5bf63a128 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.345456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0111-4a31-4533-ac21-67e5bf63a128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.383008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-705f0111-4a31-4533-ac21-67e5bf63a128 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:33.385092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-705f0111-4a31-4533-ac21-67e5bf63a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:33.465784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:33.542574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1200/2362] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:33.544057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e053b69-2e3d-4c6d-8781-2ac39f664de9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.544346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e053b69-2e3d-4c6d-8781-2ac39f664de9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.544626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e053b69-2e3d-4c6d-8781-2ac39f664de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.581311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4e053b69-2e3d-4c6d-8781-2ac39f664de9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:33.586689 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4e053b69-2e3d-4c6d-8781-2ac39f664de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:33.602668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1163/2363] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:33.607198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0111-4a31-4533-ac21-67e5bf63a128 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:33.619958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0111-4a31-4533-ac21-67e5bf63a128 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:33.641733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:33.641733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.642907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.642907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.642907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:33.643236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:33.644958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:33.666743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e053b69-2e3d-4c6d-8781-2ac39f664de9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:33.672941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1201/2364] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:33.677104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e053b69-2e3d-4c6d-8781-2ac39f664de9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:33.682612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:33.683376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.683737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.684119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.685020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:33.687707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:33.734521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1164/2365] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:33 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:33.738808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:33.749639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291f7fb-6e8e-4b83-bdd3-d2067b6beb5e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:33.830998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:33.833406 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.833787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.834304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.835012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:33.837529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:33.877672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1202/2366] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:33 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:04:33.882153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:33.911064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1310ce4-8bb4-46b5-884f-d77c13f8adc2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:33.941413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:33.942158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.942520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.942868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.943906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:33.945401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:33.961727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1165/2367] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:33.964586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:33.975521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de2cce-4ae7-4058-b8c4-e864e5f74a74 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:33.981028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811ac9d-027b-42bb-9fc1-f0baf2e62d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:33.981709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ac9d-027b-42bb-9fc1-f0baf2e62d20 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:33.981997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ac9d-027b-42bb-9fc1-f0baf2e62d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:33.982317 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ac9d-027b-42bb-9fc1-f0baf2e62d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:33.983409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811ac9d-027b-42bb-9fc1-f0baf2e62d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:33.985034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811ac9d-027b-42bb-9fc1-f0baf2e62d20 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:34.000618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1203/2368] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:34.001140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:34.017917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c61f74-e14c-43cb-9283-35e749ee8232 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:34.023908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:34.024843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.025218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.025659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] PATH_INFO: `/v3/projects/4e59508a7d834f8d8c94ff8e1f883512/users/3ba0da3ff7b24a3bb9474d02db79140d/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.048473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e59508a7d834f8d8c94ff8e1f883512, user_id=3ba0da3ff7b24a3bb9474d02db79140d, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:34.051421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:34.073401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1166/2369] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:33 2022] PUT /identity/v3/projects/4e59508a7d834f8d8c94ff8e1f883512/users/3ba0da3ff7b24a3bb9474d02db79140d/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:04:34.085047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cdd3-885c-4df5-8260-44064808f948 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.085676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cdd3-885c-4df5-8260-44064808f948 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.085971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cdd3-885c-4df5-8260-44064808f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.146941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d593cdd3-885c-4df5-8260-44064808f948 None None] MFA Rules not processed for user `3ba0da3ff7b24a3bb9474d02db79140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:34.148759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d593cdd3-885c-4df5-8260-44064808f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:34.236434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1204/2370] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:34.248756 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:34.251552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:34.331995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c00d5-6777-4634-907d-aeab5bc50eb5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:34.336385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8450757-2159-458b-9a02-ff4b59a54db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:34.337356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450757-2159-458b-9a02-ff4b59a54db3 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.337659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450757-2159-458b-9a02-ff4b59a54db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.337941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450757-2159-458b-9a02-ff4b59a54db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.347205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8450757-2159-458b-9a02-ff4b59a54db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:34.348559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8450757-2159-458b-9a02-ff4b59a54db3 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:34.359058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1167/2371] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:04:38.639533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593cdd3-885c-4df5-8260-44064808f948 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:38.688549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:38.719881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593cdd3-885c-4df5-8260-44064808f948 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:38.731434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:38.733561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:38.734013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:38.734469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] PATH_INFO: `/v3/users/3ba0da3ff7b24a3bb9474d02db79140d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:38.736438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba0da3ff7b24a3bb9474d02db79140d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:38.738612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:38.838288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba0da3ff7b24a3bb9474d02db79140d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:38.848076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba0da3ff7b24a3bb9474d02db79140d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:38.858014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba0da3ff7b24a3bb9474d02db79140d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:38.881046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba0da3ff7b24a3bb9474d02db79140d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:38.882286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba0da3ff7b24a3bb9474d02db79140d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:38.894935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1205/2372] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:38 2022] DELETE /identity/v3/users/3ba0da3ff7b24a3bb9474d02db79140d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:38.897692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:38.898871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:38.899376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:38.921418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:38.922901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:38.989833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:39.033439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1168/2373] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:39.044424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:39.045840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:39.117503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466e19-2136-4068-b301-7828404a0cfc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:39.121971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28413c92-17ef-4b60-a5bf-1a98a0afb69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:39.122723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413c92-17ef-4b60-a5bf-1a98a0afb69d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:39.123027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413c92-17ef-4b60-a5bf-1a98a0afb69d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:39.124431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413c92-17ef-4b60-a5bf-1a98a0afb69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:39.137928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28413c92-17ef-4b60-a5bf-1a98a0afb69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:39.144576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28413c92-17ef-4b60-a5bf-1a98a0afb69d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:39.157646 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1206/2374] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:39.463669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:39.465266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:39.478410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47b41-b6b9-4a23-8ff0-8f4a9df729d8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:39.483963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:39.484876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:39.485113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:39.485385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] PATH_INFO: `/v3/projects/4e59508a7d834f8d8c94ff8e1f883512` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:39.486735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e59508a7d834f8d8c94ff8e1f883512)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:39.488618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:39.537074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e59508a7d834f8d8c94ff8e1f883512', 'request_id': 'req-08d94f37-928a-414d-bda5-928eb61a0f33'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:39.544068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e59508a7d834f8d8c94ff8e1f883512', 'request_id': 'req-08d94f37-928a-414d-bda5-928eb61a0f33'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:39.553141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e59508a7d834f8d8c94ff8e1f883512', 'request_id': 'req-08d94f37-928a-414d-bda5-928eb61a0f33'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:39.567271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] The token cache is being invalidate because project 4e59508a7d834f8d8c94ff8e1f883512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:39.567570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:39.568520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-08d94f37-928a-414d-bda5-928eb61a0f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:39.570382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1169/2375] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:39 2022] DELETE /identity/v3/projects/4e59508a7d834f8d8c94ff8e1f883512 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:39.575478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed5c5-e31c-47b1-8936-7839b4159e22 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:39.575776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed5c5-e31c-47b1-8936-7839b4159e22 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:39.576107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed5c5-e31c-47b1-8936-7839b4159e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:39.594047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-231ed5c5-e31c-47b1-8936-7839b4159e22 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:39.595479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-231ed5c5-e31c-47b1-8936-7839b4159e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:39.654981 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:39.674458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1207/2376] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:39.681315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d33c4-48c7-427c-b8ac-fedafda27c38 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:39.681315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d33c4-48c7-427c-b8ac-fedafda27c38 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:39.681626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d33c4-48c7-427c-b8ac-fedafda27c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:39.702003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a78d33c4-48c7-427c-b8ac-fedafda27c38 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:39.703364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a78d33c4-48c7-427c-b8ac-fedafda27c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:39.712190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1170/2377] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:39.716529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed5c5-e31c-47b1-8936-7839b4159e22 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:39.732216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed5c5-e31c-47b1-8936-7839b4159e22 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:39.737089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:39.737752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:39.738053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:39.738338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:39.739290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:39.739601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:39.741214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:39.753341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1208/2378] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:39.758854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d33c4-48c7-427c-b8ac-fedafda27c38 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:39.770033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d33c4-48c7-427c-b8ac-fedafda27c38 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:39.792988 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:39.794132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:39.794521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:39.795194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:39.795947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:39.800145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:39.837145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1171/2379] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:39 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:04:39.838695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:39.848654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d657c3-b4d2-4279-9ea3-09f3a7544667 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:39.936368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:39.937208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:39.937532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:39.937923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:39.938734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:39.940903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:39.972538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1209/2380] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:39 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:04:39.988587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.012223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7132-d439-4b06-8d87-5e0796ba6664 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.019005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.019760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.020115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.020641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.022705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.024502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.037378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1172/2381] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:40.041374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.056000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380013-9270-4737-b63b-dd1136ec82cb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.061266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.061946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.062260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.062564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.063256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.064866 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.076837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1210/2382] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:04:40.080616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.091147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e62ed-3328-4d73-9bf9-48ed7ecda818 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.098292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db0d5d-f6de-4e4e-86c5-2631ffef09d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.098292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db0d5d-f6de-4e4e-86c5-2631ffef09d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.098292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db0d5d-f6de-4e4e-86c5-2631ffef09d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.098292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db0d5d-f6de-4e4e-86c5-2631ffef09d7 admin admin] PATH_INFO: `/v3/projects/2fdd8da1feb7437cab7edd8518f33a11/users/28da318538da4c5d9ab77a70f8d4c5ad/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.099926 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.102059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.115106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db0d5d-f6de-4e4e-86c5-2631ffef09d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fdd8da1feb7437cab7edd8518f33a11, user_id=28da318538da4c5d9ab77a70f8d4c5ad, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.115893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873c389-844b-41fd-a2e2-667b1f36a3dc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.117784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db0d5d-f6de-4e4e-86c5-2631ffef09d7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.120997 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.122057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.122325 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.122618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] PATH_INFO: `/v3/users/94f560ad2a1442b19dae037a7adef7c5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.123876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f560ad2a1442b19dae037a7adef7c5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.125823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.132704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1173/2383] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:40 2022] PUT /identity/v3/projects/2fdd8da1feb7437cab7edd8518f33a11/users/28da318538da4c5d9ab77a70f8d4c5ad/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:04:40.143377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.143667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.143946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.173178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] MFA Rules not processed for user `28da318538da4c5d9ab77a70f8d4c5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:40.174573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.183183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f560ad2a1442b19dae037a7adef7c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.192852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f560ad2a1442b19dae037a7adef7c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.203893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f560ad2a1442b19dae037a7adef7c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.220471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f560ad2a1442b19dae037a7adef7c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.220664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3ebbbfaf-41ce-4850-825a-059a951c39a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f560ad2a1442b19dae037a7adef7c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.226983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1211/2384] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:40 2022] DELETE /identity/v3/users/94f560ad2a1442b19dae037a7adef7c5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:04:40.230026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:40.231870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.232157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.232737 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.251879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:40.253203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.255785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1174/2385] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:04:40.268290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.272585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.297349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:40.346612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1212/2386] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:40.359569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.361286 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.385552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47f809-63e7-4934-a516-14fa2a5a40d4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.474871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed310ca9-f0ab-4a63-a299-e053c4bb5be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.475538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310ca9-f0ab-4a63-a299-e053c4bb5be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.476259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310ca9-f0ab-4a63-a299-e053c4bb5be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.476259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310ca9-f0ab-4a63-a299-e053c4bb5be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.481596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b92dd-a427-4210-bfbb-c01812863273 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.486020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.486785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.487073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.487407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.497372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.498949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.509890 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1213/2387] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:40.562139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed310ca9-f0ab-4a63-a299-e053c4bb5be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.562139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed310ca9-f0ab-4a63-a299-e053c4bb5be1 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.576272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1175/2388] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:04:40.609161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.610952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.625128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6bc97-f0e8-406e-a6e3-b8adc83cd6b8 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.630381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.631241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.631611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.632067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] PATH_INFO: `/v3/users/28da318538da4c5d9ab77a70f8d4c5ad` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.633601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28da318538da4c5d9ab77a70f8d4c5ad)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.636240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.687328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28da318538da4c5d9ab77a70f8d4c5ad'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.694502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28da318538da4c5d9ab77a70f8d4c5ad'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.704787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28da318538da4c5d9ab77a70f8d4c5ad'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.722027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28da318538da4c5d9ab77a70f8d4c5ad'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.722826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28da318538da4c5d9ab77a70f8d4c5ad'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:40.740455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1214/2389] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:40 2022] DELETE /identity/v3/users/28da318538da4c5d9ab77a70f8d4c5ad => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:40.745179 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.745472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.745753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.778591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:40.779854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.842202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:40.854860 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1176/2390] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:40.864976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.866637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.930669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.932494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.950782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871236-e3ba-4ffc-b188-8e796673687f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.956999 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.957780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.958218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.958608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.964564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92bd9f-36b1-4410-b447-997b32678fb6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.980488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:40.985677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.986781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.987488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.987488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] PATH_INFO: `/v3/projects/9b04780bf02a47d791a688b79eda9eb2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.989077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b04780bf02a47d791a688b79eda9eb2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.996853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.997049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.997049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:41.024645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1215/2391] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:41.118088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b04780bf02a47d791a688b79eda9eb2', 'request_id': 'req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.128797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b04780bf02a47d791a688b79eda9eb2', 'request_id': 'req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.139655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b04780bf02a47d791a688b79eda9eb2', 'request_id': 'req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.156514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] The token cache is being invalidate because project 9b04780bf02a47d791a688b79eda9eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:41.157067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.157761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.162953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1177/2392] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:40 2022] DELETE /identity/v3/projects/9b04780bf02a47d791a688b79eda9eb2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:04:41.423200 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:41.424980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:41.464567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac9300-35c9-4d98-bc1a-60043174fb43 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:41.586440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:41.587401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:41.587844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:41.588299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] PATH_INFO: `/v3/projects/2fdd8da1feb7437cab7edd8518f33a11` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:41.590605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fdd8da1feb7437cab7edd8518f33a11)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:41.592693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:41.649579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fdd8da1feb7437cab7edd8518f33a11', 'request_id': 'req-41aeabfa-08e5-44ec-afeb-b19e507cecfb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.656591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fdd8da1feb7437cab7edd8518f33a11', 'request_id': 'req-41aeabfa-08e5-44ec-afeb-b19e507cecfb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.666890 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fdd8da1feb7437cab7edd8518f33a11', 'request_id': 'req-41aeabfa-08e5-44ec-afeb-b19e507cecfb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.678822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] The token cache is being invalidate because project 2fdd8da1feb7437cab7edd8518f33a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:41.679122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.679836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41aeabfa-08e5-44ec-afeb-b19e507cecfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:41.681533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1216/2393] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:41 2022] DELETE /identity/v3/projects/2fdd8da1feb7437cab7edd8518f33a11 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:51.152007 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:51.675368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:55.669662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:55.671234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:55.684569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8d4ba-eb89-431c-ab17-7b80826b9f59 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:55.743764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:55.744761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.745417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.745563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] PATH_INFO: `/v3/users/85b091d131094c41b9342eea9bc0d4d8` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.746753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b091d131094c41b9342eea9bc0d4d8)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:55.748706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:55.801479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b091d131094c41b9342eea9bc0d4d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:55.809158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b091d131094c41b9342eea9bc0d4d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:55.818690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b091d131094c41b9342eea9bc0d4d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:55.832353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b091d131094c41b9342eea9bc0d4d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:55.833169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b091d131094c41b9342eea9bc0d4d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:55.839460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1178/2394] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:55 2022] DELETE /identity/v3/users/85b091d131094c41b9342eea9bc0d4d8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:55.844318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1540-4853-4422-a26c-f360d96d538f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.844812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1540-4853-4422-a26c-f360d96d538f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.844935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1540-4853-4422-a26c-f360d96d538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.863167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-535f1540-4853-4422-a26c-f360d96d538f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:55.864314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-535f1540-4853-4422-a26c-f360d96d538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:55.932825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1217/2395] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:55.945088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:55.947162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:56.014312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb8931-30d8-49ab-9d87-c88b37ec01c8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:56.018187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:56.018844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:56.019125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:56.019397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:56.033551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:56.035227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:56.045809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1179/2396] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:56.336163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1540-4853-4422-a26c-f360d96d538f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:56.337729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-535f1540-4853-4422-a26c-f360d96d538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:56.350876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1540-4853-4422-a26c-f360d96d538f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:56.357345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:56.358708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:56.359067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:56.359544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] PATH_INFO: `/v3/projects/fbc3c1dfb6f04b22adbff7638547b485` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:56.360687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc3c1dfb6f04b22adbff7638547b485)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:56.362935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:56.415821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc3c1dfb6f04b22adbff7638547b485', 'request_id': 'req-2b104745-4ed3-4e59-8011-7a03d93cb1a5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.424796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc3c1dfb6f04b22adbff7638547b485', 'request_id': 'req-2b104745-4ed3-4e59-8011-7a03d93cb1a5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.435366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc3c1dfb6f04b22adbff7638547b485', 'request_id': 'req-2b104745-4ed3-4e59-8011-7a03d93cb1a5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.446220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] The token cache is being invalidate because project fbc3c1dfb6f04b22adbff7638547b485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:56.446513 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.447151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.448951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1218/2397] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:56 2022] DELETE /identity/v3/projects/fbc3c1dfb6f04b22adbff7638547b485 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:56.453029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:56.462608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7b2d-6a10-4a2b-bf9b-c221cb83f925 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:56.485112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:56.536751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:56.537639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:56.537918 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:56.538221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] PATH_INFO: `/v3/users/7ff3cd3b69e14c87b7b2466c282ea5c9` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:56.539441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff3cd3b69e14c87b7b2466c282ea5c9)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:56.541619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:56.597398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff3cd3b69e14c87b7b2466c282ea5c9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.605679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff3cd3b69e14c87b7b2466c282ea5c9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.616792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff3cd3b69e14c87b7b2466c282ea5c9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.630001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff3cd3b69e14c87b7b2466c282ea5c9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.630694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e884a179-04ee-4304-93f3-12a0512d9479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff3cd3b69e14c87b7b2466c282ea5c9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:56.637625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1180/2398] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:04:56 2022] DELETE /identity/v3/users/7ff3cd3b69e14c87b7b2466c282ea5c9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:56.928781 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:56.930338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:56.947902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b104745-4ed3-4e59-8011-7a03d93cb1a5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.008202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.009084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.009369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.009647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] PATH_INFO: `/v3/projects/ae0ed1ab2e3e4871b3950ff69039d542` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.010862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0ed1ab2e3e4871b3950ff69039d542)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.012921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.046828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:57.066164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0ed1ab2e3e4871b3950ff69039d542', 'request_id': 'req-2ed641f8-d400-45c1-98df-93193385d5a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:57.073373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0ed1ab2e3e4871b3950ff69039d542', 'request_id': 'req-2ed641f8-d400-45c1-98df-93193385d5a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:57.083537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0ed1ab2e3e4871b3950ff69039d542', 'request_id': 'req-2ed641f8-d400-45c1-98df-93193385d5a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:57.096894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] The token cache is being invalidate because project ae0ed1ab2e3e4871b3950ff69039d542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:04:57.097165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:57.097910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2ed641f8-d400-45c1-98df-93193385d5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:04:57.099469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1219/2399] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:04:56 2022] DELETE /identity/v3/projects/ae0ed1ab2e3e4871b3950ff69039d542 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:57.104492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4316-5770-4e09-a8e8-a90c163f75b1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.105190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4316-5770-4e09-a8e8-a90c163f75b1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.105190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4316-5770-4e09-a8e8-a90c163f75b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.138093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-259d4316-5770-4e09-a8e8-a90c163f75b1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:57.139471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-259d4316-5770-4e09-a8e8-a90c163f75b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:57.207198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1181/2400] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:57.215900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a791f-7f5c-4831-a257-9c0dcfd9f34f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.216440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a791f-7f5c-4831-a257-9c0dcfd9f34f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.216940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a791f-7f5c-4831-a257-9c0dcfd9f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.241091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-070a791f-7f5c-4831-a257-9c0dcfd9f34f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:57.242348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-070a791f-7f5c-4831-a257-9c0dcfd9f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:57.252924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1220/2401] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:57.257495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d4316-5770-4e09-a8e8-a90c163f75b1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.268112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d4316-5770-4e09-a8e8-a90c163f75b1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.275038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.275738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.276022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.276300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.277377 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:57.277687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.279403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.293432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1182/2402] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:57.298307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a791f-7f5c-4831-a257-9c0dcfd9f34f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.308407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a791f-7f5c-4831-a257-9c0dcfd9f34f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.314377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.315072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.315360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.315702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.316415 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.318374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.350069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1221/2403] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:57 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:57.354406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.365875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d8c23-1857-416f-95ac-335f48d90562 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.386098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:57.442730 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.443420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.443715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.443994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.444735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.446695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.471661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1183/2404] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:57 2022] POST /identity/v3/users => generated 282 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:57.473975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.485263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101d609-dbaa-4524-bdce-a4182cbdbd01 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.490726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.491579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.491907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.492252 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.493020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.494763 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.507290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1222/2405] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:57.511666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.521814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0c90-f896-45f9-baba-05e1b23e6c57 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.527181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85c963-238d-41d8-8e57-344232676e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.527884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c963-238d-41d8-8e57-344232676e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.528345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c963-238d-41d8-8e57-344232676e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.528716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c963-238d-41d8-8e57-344232676e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.529691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c963-238d-41d8-8e57-344232676e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.533086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c963-238d-41d8-8e57-344232676e22 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.544004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1184/2406] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:57.550372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.560604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f645b-6c78-43ad-8eea-046da4cdf613 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.565270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.566169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.566453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.566729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] PATH_INFO: `/v3/projects/716a0f14592f4d4aacc7c57331c9394c/users/59bedd6f414d4e9792e3d10b8d39a9b7/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.582139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=716a0f14592f4d4aacc7c57331c9394c, user_id=59bedd6f414d4e9792e3d10b8d39a9b7, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.584794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.599759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1223/2407] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:57 2022] PUT /identity/v3/projects/716a0f14592f4d4aacc7c57331c9394c/users/59bedd6f414d4e9792e3d10b8d39a9b7/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:57.612395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2bf99-79e7-4642-a361-69119904a8a9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.612740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2bf99-79e7-4642-a361-69119904a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.612956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2bf99-79e7-4642-a361-69119904a8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.641279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-dbe2bf99-79e7-4642-a361-69119904a8a9 None None] MFA Rules not processed for user `59bedd6f414d4e9792e3d10b8d39a9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:57.642885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dbe2bf99-79e7-4642-a361-69119904a8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:57.713412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1185/2408] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:57.718479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.785298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a9e79-63d9-4850-a1d9-9701e37045b7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.790700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.791347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.791657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.791935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.792675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.794680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.824390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1224/2409] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:04:57 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:57.828678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2bf99-79e7-4642-a361-69119904a8a9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.839537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2bf99-79e7-4642-a361-69119904a8a9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.904008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.904695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.904983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.905260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.905976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.908000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.930938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1186/2410] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:04:57 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:57.935564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.947128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4735f-ff1a-4d84-9fbd-b1a572be0254 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.952182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.952839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.953118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.953393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:57.954133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:57.955755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:57.966288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1225/2411] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:57.970791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:57.982229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a671-2baa-4e7d-90ff-74a33ce5cb45 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:57.987510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:57.988424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:57.988709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:57.988985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] PATH_INFO: `/v3/projects/86b5d20db12b4b4793ecd5cfaba52b75/users/067c19ca8f1a4725b6b6546225533f7d/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:58.007319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b5d20db12b4b4793ecd5cfaba52b75, user_id=067c19ca8f1a4725b6b6546225533f7d, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:58.010076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:58.012528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:58.026895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1187/2412] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:57 2022] PUT /identity/v3/projects/86b5d20db12b4b4793ecd5cfaba52b75/users/067c19ca8f1a4725b6b6546225533f7d/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:58.031058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:58.041346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c424ec-6e43-4157-97f5-49010fcdc38d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:58.063023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:58.105650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b985ac-249f-434a-adc3-d76cfd97015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:58.106494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b985ac-249f-434a-adc3-d76cfd97015f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:58.106813 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b985ac-249f-434a-adc3-d76cfd97015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:58.107093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b985ac-249f-434a-adc3-d76cfd97015f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:58.107823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b985ac-249f-434a-adc3-d76cfd97015f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:58.109857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b985ac-249f-434a-adc3-d76cfd97015f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:58.120157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1226/2413] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:04:58.127401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:58.143429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d862f2-dd37-4b07-bfa6-fa9a66b543cb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:58.152383 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:58.153667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:58.153946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:58.154257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] PATH_INFO: `/v3/projects/86b5d20db12b4b4793ecd5cfaba52b75/users/067c19ca8f1a4725b6b6546225533f7d/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:58.156540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b5d20db12b4b4793ecd5cfaba52b75, user_id=067c19ca8f1a4725b6b6546225533f7d, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:58.159241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:58.171449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1188/2414] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:04:58 2022] PUT /identity/v3/projects/86b5d20db12b4b4793ecd5cfaba52b75/users/067c19ca8f1a4725b6b6546225533f7d/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:58.183340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:58.184393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:58.184721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:58.217731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] MFA Rules not processed for user `067c19ca8f1a4725b6b6546225533f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:58.219045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:58.317327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1227/2415] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:04:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:04:58.334153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:58.334153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:58.411209 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba0bdf-f632-4c73-b15b-932b8eb563f2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:58.422334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:58.423399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:58.423399 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:58.423705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:58.433747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:58.435657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:58.447245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1189/2416] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:04:58.530612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:58.532070 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:58.550885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310408b6-9785-4cd0-a3ea-01e7f04dd743 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:58.558256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7e5d-c3dc-404e-8588-e343256db36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:58.559104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7e5d-c3dc-404e-8588-e343256db36a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:58.559400 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7e5d-c3dc-404e-8588-e343256db36a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:58.559674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7e5d-c3dc-404e-8588-e343256db36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:58.627951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7e5d-c3dc-404e-8588-e343256db36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:58.630265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7e5d-c3dc-404e-8588-e343256db36a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:58.642387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1228/2417] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:04:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:01.444449 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:01.514226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b872f-63ec-4f47-8d7f-c0d38a604a55 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:01.519077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:01.520581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:01.520876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:01.521133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] PATH_INFO: `/v3/users/59bedd6f414d4e9792e3d10b8d39a9b7` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:01.522406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=59bedd6f414d4e9792e3d10b8d39a9b7)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:01.524350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:01.580679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59bedd6f414d4e9792e3d10b8d39a9b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:01.590181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59bedd6f414d4e9792e3d10b8d39a9b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:01.599650 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59bedd6f414d4e9792e3d10b8d39a9b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:01.612148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59bedd6f414d4e9792e3d10b8d39a9b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:01.612784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59bedd6f414d4e9792e3d10b8d39a9b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:01.618704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1190/2418] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:05:01 2022] DELETE /identity/v3/users/59bedd6f414d4e9792e3d10b8d39a9b7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:01.623454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193e46-7071-49e6-aaa4-0f74e421e3d8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:01.624085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193e46-7071-49e6-aaa4-0f74e421e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:01.624085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193e46-7071-49e6-aaa4-0f74e421e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:01.642399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ef193e46-7071-49e6-aaa4-0f74e421e3d8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:01.643626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ef193e46-7071-49e6-aaa4-0f74e421e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:01.689782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:01.718522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1229/2419] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:01.729224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:01.731595 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:01.738908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:01.801180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c612-d923-430a-ac42-9fa2d14be3dd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:01.805078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:01.805747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:01.806029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:01.806339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:01.816572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:01.818021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:01.828026 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1191/2420] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:02.096174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193e46-7071-49e6-aaa4-0f74e421e3d8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:02.111618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193e46-7071-49e6-aaa4-0f74e421e3d8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:02.117232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:02.119617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:02.119964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:02.120258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:02.122498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:02.225676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:02.228282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:02.243238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:02.243517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1230/2421] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:02.247241 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:02.265793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70be9-8b20-4257-a66f-33f5eb2c1340 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:02.271573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:02.272570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:02.272951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:02.273328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] PATH_INFO: `/v3/projects/716a0f14592f4d4aacc7c57331c9394c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:02.274691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=716a0f14592f4d4aacc7c57331c9394c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:02.277137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:02.351567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716a0f14592f4d4aacc7c57331c9394c', 'request_id': 'req-8f603df3-39b5-4486-921a-b8d6692e4f10'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.367437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716a0f14592f4d4aacc7c57331c9394c', 'request_id': 'req-8f603df3-39b5-4486-921a-b8d6692e4f10'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.382025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716a0f14592f4d4aacc7c57331c9394c', 'request_id': 'req-8f603df3-39b5-4486-921a-b8d6692e4f10'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.406778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] The token cache is being invalidate because project 716a0f14592f4d4aacc7c57331c9394c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:05:02.407121 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.407901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.413216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1192/2422] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:05:02 2022] DELETE /identity/v3/projects/716a0f14592f4d4aacc7c57331c9394c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:02.413925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:02.426185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f34bed-c077-41c0-958b-6cf67322b7da service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:02.528565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:02.529867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:02.536758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:02.536758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] PATH_INFO: `/v3/users/067c19ca8f1a4725b6b6546225533f7d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:02.536758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=067c19ca8f1a4725b6b6546225533f7d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:02.536758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:02.626568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067c19ca8f1a4725b6b6546225533f7d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.636501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067c19ca8f1a4725b6b6546225533f7d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.649390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067c19ca8f1a4725b6b6546225533f7d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.677993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067c19ca8f1a4725b6b6546225533f7d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.677993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-add12a69-14ab-4ba7-b00a-252e46bc7dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067c19ca8f1a4725b6b6546225533f7d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:02.677993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:02.683156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1231/2423] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:05:02 2022] DELETE /identity/v3/users/067c19ca8f1a4725b6b6546225533f7d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:05:03.266439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:03.268581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:03.285445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f603df3-39b5-4486-921a-b8d6692e4f10 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:03.369421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:03.370540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.370958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.371469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] PATH_INFO: `/v3/projects/86b5d20db12b4b4793ecd5cfaba52b75` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.373637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b5d20db12b4b4793ecd5cfaba52b75)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:03.375849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:03.424170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:03.445598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b5d20db12b4b4793ecd5cfaba52b75', 'request_id': 'req-98987317-7e02-4485-9bb3-599016a5f42f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:03.458992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b5d20db12b4b4793ecd5cfaba52b75', 'request_id': 'req-98987317-7e02-4485-9bb3-599016a5f42f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:03.470982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b5d20db12b4b4793ecd5cfaba52b75', 'request_id': 'req-98987317-7e02-4485-9bb3-599016a5f42f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:03.486169 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] The token cache is being invalidate because project 86b5d20db12b4b4793ecd5cfaba52b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:05:03.486375 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:03.487116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98987317-7e02-4485-9bb3-599016a5f42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:03.489023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1193/2424] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:05:03 2022] DELETE /identity/v3/projects/86b5d20db12b4b4793ecd5cfaba52b75 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:03.493881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9d88-2211-4cb5-be6a-8ecbac078822 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.494358 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9d88-2211-4cb5-be6a-8ecbac078822 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.494736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9d88-2211-4cb5-be6a-8ecbac078822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.516271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4fdf9d88-2211-4cb5-be6a-8ecbac078822 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:03.517651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fdf9d88-2211-4cb5-be6a-8ecbac078822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:03.596107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1232/2425] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:03.605232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a41d-2e66-4cfc-b8a3-475d2eccc13d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.605789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a41d-2e66-4cfc-b8a3-475d2eccc13d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.606168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a41d-2e66-4cfc-b8a3-475d2eccc13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.628720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d958a41d-2e66-4cfc-b8a3-475d2eccc13d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:03.630045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d958a41d-2e66-4cfc-b8a3-475d2eccc13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:03.642521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1194/2426] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:03.645390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf9d88-2211-4cb5-be6a-8ecbac078822 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:03.657594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf9d88-2211-4cb5-be6a-8ecbac078822 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:03.662567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d982fde-b98f-474d-829a-d6f5cdc7f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:03.663254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d982fde-b98f-474d-829a-d6f5cdc7f757 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.663543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d982fde-b98f-474d-829a-d6f5cdc7f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.663823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d982fde-b98f-474d-829a-d6f5cdc7f757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.664825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d982fde-b98f-474d-829a-d6f5cdc7f757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:05:03.665140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d982fde-b98f-474d-829a-d6f5cdc7f757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:03.666947 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d982fde-b98f-474d-829a-d6f5cdc7f757 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:03.690151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958a41d-2e66-4cfc-b8a3-475d2eccc13d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:03.691840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1233/2427] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:05:03.703035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958a41d-2e66-4cfc-b8a3-475d2eccc13d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:03.708474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:03.709410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.709845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.710294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.711154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:03.713865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:03.755749 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1195/2428] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:05:03 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:05:03.763820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:03.764536 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea98b-e6c0-40fe-bcca-6cefd9c8a82b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.764989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea98b-e6c0-40fe-bcca-6cefd9c8a82b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.765363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea98b-e6c0-40fe-bcca-6cefd9c8a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.792756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bcfea98b-e6c0-40fe-bcca-6cefd9c8a82b None None] MFA Rules not processed for user `010c4d5ba6b847b79d3127787db2ddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:03.794033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bcfea98b-e6c0-40fe-bcca-6cefd9c8a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:03.888025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdb1a1-0a9b-45a8-95f6-b9844478197d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:03.896395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:03.901232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.901232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.901232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.901232 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:03.902238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:03.914224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1234/2429] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:03.947859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea98b-e6c0-40fe-bcca-6cefd9c8a82b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:03.960757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1196/2430] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:05:03 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:05:03.971474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea98b-e6c0-40fe-bcca-6cefd9c8a82b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:03.979472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:03.981700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:03.982381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:03.983059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:03.984440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:03.987546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:04.001028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1235/2431] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:05:04.006632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:04.027258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e550a6-c054-4389-9517-1603e026d076 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:04.035726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b78e-5f73-44b3-ba01-98b6200b2b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:04.036521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b78e-5f73-44b3-ba01-98b6200b2b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:04.036933 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b78e-5f73-44b3-ba01-98b6200b2b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:04.037286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b78e-5f73-44b3-ba01-98b6200b2b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:04.038367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7b78e-5f73-44b3-ba01-98b6200b2b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:04.040842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7b78e-5f73-44b3-ba01-98b6200b2b05 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:04.056424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1197/2432] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:05:04.061487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:04.073159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25f4e4-d132-4ffb-88c6-ecd7d00f41c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:04.089273 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:04.090604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:04.090998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:04.091435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] PATH_INFO: `/v3/projects/0f5a06ca203f4b369c46c70d80a5f320/users/f9a03db9186b4341a8c2f134fa988ba0/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:04.122277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5a06ca203f4b369c46c70d80a5f320, user_id=f9a03db9186b4341a8c2f134fa988ba0, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:04.126783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:04.163007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1236/2433] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:05:04 2022] PUT /identity/v3/projects/0f5a06ca203f4b369c46c70d80a5f320/users/f9a03db9186b4341a8c2f134fa988ba0/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:05:04.174571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:04.174872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:04.175239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:04.225728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] MFA Rules not processed for user `f9a03db9186b4341a8c2f134fa988ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:04.227213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:04.313420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:04.320633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1198/2434] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:04.331776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:04.333602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:04.402135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79edf-55f0-415a-8a41-a0ddc0f66d0f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:04.407337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:04.408894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:04.408894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:04.408894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:04.419405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:04.423644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:04.432741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:04.443978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1237/2435] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:14.334503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:14.443760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:25.461364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:25.464166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:25.560352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122630c2-cc45-4ef7-84dc-f585259684cf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:25.567547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad470793-7d5d-474b-b702-08c1eb856aad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:25.568213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470793-7d5d-474b-b702-08c1eb856aad service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:25.568493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470793-7d5d-474b-b702-08c1eb856aad service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:25.568766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470793-7d5d-474b-b702-08c1eb856aad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:25.570753 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ad470793-7d5d-474b-b702-08c1eb856aad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:25.583000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad470793-7d5d-474b-b702-08c1eb856aad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:25.584574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad470793-7d5d-474b-b702-08c1eb856aad service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:25.594638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1199/2436] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:35.590259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=41 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:35.922498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:35.924083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:36.013495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8580bfe-946f-4ae7-be73-12b3ec3eeb0d service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:36.019989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:36.021535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:36.022729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:36.023372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] PATH_INFO: `/v3/users/564db89f205644ac98a78ec971da428c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:36.025980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564db89f205644ac98a78ec971da428c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:36.028175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:36.106980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564db89f205644ac98a78ec971da428c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.116497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564db89f205644ac98a78ec971da428c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.127920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564db89f205644ac98a78ec971da428c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.146735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564db89f205644ac98a78ec971da428c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.147627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564db89f205644ac98a78ec971da428c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.158205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1238/2437] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:05:35 2022] DELETE /identity/v3/users/564db89f205644ac98a78ec971da428c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:36.159920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:36.160393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:36.160726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:36.189278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:36.190729 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:36.278690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1200/2438] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:36.288620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:36.290069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:36.353445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a10ca-74d1-4d46-add3-75d84d4b7866 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:36.357482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:36.358150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:36.358449 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:36.358723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:36.370063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:36.371538 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:36.382949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1239/2439] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:36.673215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:36.674843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:36.687070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c42c2b-cb63-4c48-8149-9950225b6e23 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:36.693831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:36.694890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:36.695288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:36.695649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] PATH_INFO: `/v3/projects/d79b255da8a64ac3812a913bb9d5467f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:36.697002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79b255da8a64ac3812a913bb9d5467f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:36.699183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:36.758269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79b255da8a64ac3812a913bb9d5467f', 'request_id': 'req-f41890a1-ac51-4675-b0b4-9b359c262f29'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.765025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79b255da8a64ac3812a913bb9d5467f', 'request_id': 'req-f41890a1-ac51-4675-b0b4-9b359c262f29'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.774579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79b255da8a64ac3812a913bb9d5467f', 'request_id': 'req-f41890a1-ac51-4675-b0b4-9b359c262f29'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.786266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] The token cache is being invalidate because project d79b255da8a64ac3812a913bb9d5467f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:05:36.786612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.787274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f41890a1-ac51-4675-b0b4-9b359c262f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:36.789156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1201/2440] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:05:36 2022] DELETE /identity/v3/projects/d79b255da8a64ac3812a913bb9d5467f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:39.550540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:39.552277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:39.566693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803d403-b9d8-4d55-be14-48882ec6c63b service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:39.586056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:39.625161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:39.626060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:39.626373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:39.626644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] PATH_INFO: `/v3/users/647c280b8def48a48352ae1545285562` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:39.627941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=647c280b8def48a48352ae1545285562)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:39.629855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:39.679271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647c280b8def48a48352ae1545285562'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:39.686271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647c280b8def48a48352ae1545285562'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:39.695479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647c280b8def48a48352ae1545285562'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:39.707338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647c280b8def48a48352ae1545285562'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:39.707964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647c280b8def48a48352ae1545285562'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:39.713876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1240/2441] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:05:39 2022] DELETE /identity/v3/users/647c280b8def48a48352ae1545285562 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:39.718425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:39.718890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:39.719008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:39.738004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:39.739253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:39.813979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1202/2442] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:39.824464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:39.826160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:39.900571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c067c-6572-4fec-81ff-00af0f2b75bf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:39.905173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e3e63-7746-4438-9014-1d8dd588cf77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:39.905830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3e63-7746-4438-9014-1d8dd588cf77 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:39.906133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3e63-7746-4438-9014-1d8dd588cf77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:39.906412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3e63-7746-4438-9014-1d8dd588cf77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:39.916417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e3e63-7746-4438-9014-1d8dd588cf77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:39.917857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e3e63-7746-4438-9014-1d8dd588cf77 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:39.927940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1241/2443] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:05:40.232456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.234514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:40.251580 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85898cf-e641-4bc0-9ac1-ad1961685b46 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:40.257687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:40.258408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.258680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.258980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] PATH_INFO: `/v3/projects/415cf8d1309246d0879aa26adfd2bc7b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.260034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=415cf8d1309246d0879aa26adfd2bc7b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:40.261980 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:40.284769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:40.311925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415cf8d1309246d0879aa26adfd2bc7b', 'request_id': 'req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:40.318433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415cf8d1309246d0879aa26adfd2bc7b', 'request_id': 'req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:40.328963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415cf8d1309246d0879aa26adfd2bc7b', 'request_id': 'req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:40.340033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] The token cache is being invalidate because project 415cf8d1309246d0879aa26adfd2bc7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:05:40.340324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:40.340984 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f1a7a39b-d3e0-4dd8-b34d-4f967dfc11ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:40.342629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1203/2444] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:05:40 2022] DELETE /identity/v3/projects/415cf8d1309246d0879aa26adfd2bc7b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:40.347706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4d6c-93ea-4dfc-9950-9f84f4493f5a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.347934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4d6c-93ea-4dfc-9950-9f84f4493f5a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.348205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4d6c-93ea-4dfc-9950-9f84f4493f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.367099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d7fb4d6c-93ea-4dfc-9950-9f84f4493f5a None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:40.368298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d7fb4d6c-93ea-4dfc-9950-9f84f4493f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:40.408604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:40.429248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1242/2445] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:40.441099 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4fe11-423c-4014-a3e8-5378c651d592 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.441524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4fe11-423c-4014-a3e8-5378c651d592 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.441932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4fe11-423c-4014-a3e8-5378c651d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.467930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-67e4fe11-423c-4014-a3e8-5378c651d592 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:40.469190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-67e4fe11-423c-4014-a3e8-5378c651d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:40.479410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1204/2446] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:40.486508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb4d6c-93ea-4dfc-9950-9f84f4493f5a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.496994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb4d6c-93ea-4dfc-9950-9f84f4493f5a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:40.502831 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:40.503496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.503780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.504052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.504785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:05:40.505091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:40.506747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:40.518989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1243/2447] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:05:40.523886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4fe11-423c-4014-a3e8-5378c651d592 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.536075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4fe11-423c-4014-a3e8-5378c651d592 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:40.541260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:40.541981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.542302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.542574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.543265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:40.545256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:40.576021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1205/2448] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:05:40 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:05:40.580525 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.591263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26670e7-c832-43a9-8fd0-7ecd6e58ad8c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:40.650096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:40.650744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.651037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.651309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.651995 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:40.653950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:40.674800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1244/2449] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:05:40 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:05:40.679249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.690287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d1c54-d1af-4467-99e2-704d6e03a633 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:40.695098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:40.695772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.696057 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.696334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.697063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:40.698707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:40.709182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1206/2450] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:05:40.713341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.728838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe61cc3-e8b7-43ea-9a86-eec7ff36ec88 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:40.734806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ad5b-e7e3-4b0a-a50a-99e5e179d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:40.735480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ad5b-e7e3-4b0a-a50a-99e5e179d63f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.735764 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ad5b-e7e3-4b0a-a50a-99e5e179d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.736061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ad5b-e7e3-4b0a-a50a-99e5e179d63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.736822 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2ad5b-e7e3-4b0a-a50a-99e5e179d63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:40.738516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2ad5b-e7e3-4b0a-a50a-99e5e179d63f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:40.749695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1245/2451] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:05:40.754558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.769197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bf00f-dd4c-4882-b4b8-72241356336c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:40.774160 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:40.775505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.775982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.776429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] PATH_INFO: `/v3/projects/e69159a8e91c449cb48e97b7aeb6a04b/users/e1c80a1247ab4696af75c68957eada76/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.792133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69159a8e91c449cb48e97b7aeb6a04b, user_id=e1c80a1247ab4696af75c68957eada76, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:40.794886 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:40.810322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1207/2452] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:05:40 2022] PUT /identity/v3/projects/e69159a8e91c449cb48e97b7aeb6a04b/users/e1c80a1247ab4696af75c68957eada76/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:05:40.821863 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:40.822256 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:40.822542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:40.849856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] MFA Rules not processed for user `e1c80a1247ab4696af75c68957eada76`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:40.851077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:40.917741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1246/2453] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:40.929695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:40.931692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:41.014424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242d3bb-f466-4a3b-8271-2bbcf8c6f10b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:41.018250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bab7ae-0337-4bdf-81c9-2c15f596ebb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:41.018905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab7ae-0337-4bdf-81c9-2c15f596ebb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:41.019186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab7ae-0337-4bdf-81c9-2c15f596ebb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:41.019469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab7ae-0337-4bdf-81c9-2c15f596ebb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:41.027930 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bab7ae-0337-4bdf-81c9-2c15f596ebb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:41.029366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bab7ae-0337-4bdf-81c9-2c15f596ebb2 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:41.039998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1208/2454] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:42.347908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:42.349502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:42.398885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:42.423865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a554b-d202-4fc0-8d0e-01cd4194d996 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:42.429590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:42.430697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:42.430989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:42.431253 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] PATH_INFO: `/v3/users/f9a03db9186b4341a8c2f134fa988ba0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:42.432582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a03db9186b4341a8c2f134fa988ba0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:42.434573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:42.491188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a03db9186b4341a8c2f134fa988ba0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:42.501507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a03db9186b4341a8c2f134fa988ba0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:42.512955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a03db9186b4341a8c2f134fa988ba0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:42.526730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a03db9186b4341a8c2f134fa988ba0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:42.527445 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a03db9186b4341a8c2f134fa988ba0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:42.534208 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1247/2455] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:05:42 2022] DELETE /identity/v3/users/f9a03db9186b4341a8c2f134fa988ba0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:42.538597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:42.539097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:42.539197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:42.558502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:42.559699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:42.581499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:42.626299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1209/2456] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:42.636383 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:42.638652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:42.700753 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b7d6e-2879-422d-9f92-6897b1c320f7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:42.704939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2f95d-a434-476b-8f7c-af10c6e3f908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:42.705602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2f95d-a434-476b-8f7c-af10c6e3f908 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:42.705886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2f95d-a434-476b-8f7c-af10c6e3f908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:42.706206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2f95d-a434-476b-8f7c-af10c6e3f908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:42.715847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2f95d-a434-476b-8f7c-af10c6e3f908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:42.717298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2f95d-a434-476b-8f7c-af10c6e3f908 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:42.727566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1248/2457] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:43.043998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.045507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:43.058356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af183-5c24-48d6-b5d5-7a643f7b8b6b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.063990 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.064880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.065166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.065441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] PATH_INFO: `/v3/projects/0f5a06ca203f4b369c46c70d80a5f320` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.066793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5a06ca203f4b369c46c70d80a5f320)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.068750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.121138 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5a06ca203f4b369c46c70d80a5f320', 'request_id': 'req-d3033d77-abc6-4f25-baa1-59985ff73c66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:43.127571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5a06ca203f4b369c46c70d80a5f320', 'request_id': 'req-d3033d77-abc6-4f25-baa1-59985ff73c66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:43.137103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5a06ca203f4b369c46c70d80a5f320', 'request_id': 'req-d3033d77-abc6-4f25-baa1-59985ff73c66'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:43.149100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] The token cache is being invalidate because project 0f5a06ca203f4b369c46c70d80a5f320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:05:43.149400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:43.150218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d3033d77-abc6-4f25-baa1-59985ff73c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:43.151948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1210/2458] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:05:43 2022] DELETE /identity/v3/projects/0f5a06ca203f4b369c46c70d80a5f320 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:05:43.157214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e4e73-f70b-4e99-a2e0-58a90267cb7e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.157508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e4e73-f70b-4e99-a2e0-58a90267cb7e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.157815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e4e73-f70b-4e99-a2e0-58a90267cb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.177908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-689e4e73-f70b-4e99-a2e0-58a90267cb7e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:43.179175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-689e4e73-f70b-4e99-a2e0-58a90267cb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:43.247783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1249/2459] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:05:43.255935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff328f-b7b1-4966-9e78-b47d915dc9d1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.256234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff328f-b7b1-4966-9e78-b47d915dc9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.256516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff328f-b7b1-4966-9e78-b47d915dc9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.276147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e4ff328f-b7b1-4966-9e78-b47d915dc9d1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:43.277361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e4ff328f-b7b1-4966-9e78-b47d915dc9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:43.286123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1211/2460] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:43.290930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e4e73-f70b-4e99-a2e0-58a90267cb7e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.298876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:43.307329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e4e73-f70b-4e99-a2e0-58a90267cb7e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.316131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.316801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.317090 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.317373 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.318139 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:05:43.318474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.320096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.332686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1250/2461] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:05:43.337162 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff328f-b7b1-4966-9e78-b47d915dc9d1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.346975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff328f-b7b1-4966-9e78-b47d915dc9d1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.352495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.353201 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.353468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.353746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.354483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.356376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.386035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1212/2462] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:05:43 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:05:43.390197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.400794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94abbfa-1e0b-470d-906a-38dd2454d779 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.458628 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.459291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.459574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.459855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.460547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.462545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.486073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1251/2463] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:05:43 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:05:43.492130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.502828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529160e-2654-41a1-8fdb-12b489bfb333 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.508778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.509445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.509723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.510001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.510754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.512355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.524342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1213/2464] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:05:43.530450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.542839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b0780-a7f5-4c25-abbb-684085e7619b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.549268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d7603-8114-4683-a1f4-bbbf7ed56da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.550146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d7603-8114-4683-a1f4-bbbf7ed56da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.550471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d7603-8114-4683-a1f4-bbbf7ed56da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.550752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d7603-8114-4683-a1f4-bbbf7ed56da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.551473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d7603-8114-4683-a1f4-bbbf7ed56da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.553113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d7603-8114-4683-a1f4-bbbf7ed56da9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.564086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1252/2465] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:05:43.568608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.579388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd5a82-9ecc-47a2-b2be-1e11e9b38e3c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.586054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.586999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.587281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.587565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] PATH_INFO: `/v3/projects/b579f36c6162451daa31ad27aa97a083/users/50ff2e53a17c4052a08ebe104034ab80/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.603788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b579f36c6162451daa31ad27aa97a083, user_id=50ff2e53a17c4052a08ebe104034ab80, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.606525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.625408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1214/2466] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:05:43 2022] PUT /identity/v3/projects/b579f36c6162451daa31ad27aa97a083/users/50ff2e53a17c4052a08ebe104034ab80/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:43.630861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83252ef-1915-4092-8271-56647ae8b74f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.631150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83252ef-1915-4092-8271-56647ae8b74f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.631423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83252ef-1915-4092-8271-56647ae8b74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.651582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a83252ef-1915-4092-8271-56647ae8b74f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:43.652738 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a83252ef-1915-4092-8271-56647ae8b74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:43.717394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1253/2467] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:43.727456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:43.729587 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:43.789405 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:43.797158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1030-cc8e-44aa-805a-f2137c0925d5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:43.803006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:43.803877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:43.804350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:43.804698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:43.815385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:43.817022 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:43.826902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1215/2468] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:44.486911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473fc1b-34ec-40e6-ad41-b281240236c7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:44.487475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473fc1b-34ec-40e6-ad41-b281240236c7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:44.487475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473fc1b-34ec-40e6-ad41-b281240236c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:44.514534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6473fc1b-34ec-40e6-ad41-b281240236c7 None None] MFA Rules not processed for user `50ff2e53a17c4052a08ebe104034ab80`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:44.515733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6473fc1b-34ec-40e6-ad41-b281240236c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:44.592687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:44.599353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1254/2469] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:44.612277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:44.613742 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:44.677070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c1bc-1513-42f5-b71e-d7af174769c6 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:44.680927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:44.681581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:44.681865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:44.682156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:44.690829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:44.692309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:44.701093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1216/2470] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:48.196109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fc9c7-9ea6-47a8-a0a4-f4e0fd5b5b1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:48.196618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fc9c7-9ea6-47a8-a0a4-f4e0fd5b5b1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:48.196618 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fc9c7-9ea6-47a8-a0a4-f4e0fd5b5b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:48.220302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6d1fc9c7-9ea6-47a8-a0a4-f4e0fd5b5b1c None None] MFA Rules not processed for user `50ff2e53a17c4052a08ebe104034ab80`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:48.221619 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6d1fc9c7-9ea6-47a8-a0a4-f4e0fd5b5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:48.229270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1255/2471] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:50.258543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:50.260123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:50.274875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a2317-01a0-4444-9388-ff3860b22fde service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:50.279891 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:50.280828 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:50.281108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:50.281384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] PATH_INFO: `/v3/users/e1c80a1247ab4696af75c68957eada76` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:50.282666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c80a1247ab4696af75c68957eada76)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:50.284743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:50.339861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c80a1247ab4696af75c68957eada76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.347896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c80a1247ab4696af75c68957eada76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.358545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c80a1247ab4696af75c68957eada76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.374145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c80a1247ab4696af75c68957eada76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.375100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c80a1247ab4696af75c68957eada76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.381977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1217/2472] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:05:50 2022] DELETE /identity/v3/users/e1c80a1247ab4696af75c68957eada76 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:05:50.386650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:50.387168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:50.387290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:50.406312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:05:50.407551 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:50.470298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1256/2473] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:05:50.480885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:50.483038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:50.544661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1ba3-b0f3-4413-bd6e-7f24a4d5f68d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:50.549279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35971fc3-ab8b-4840-ad5c-9b1790a76db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:50.550023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35971fc3-ab8b-4840-ad5c-9b1790a76db4 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:50.550457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35971fc3-ab8b-4840-ad5c-9b1790a76db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:50.550761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35971fc3-ab8b-4840-ad5c-9b1790a76db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:50.560365 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35971fc3-ab8b-4840-ad5c-9b1790a76db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:50.561852 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35971fc3-ab8b-4840-ad5c-9b1790a76db4 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:50.571647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1218/2474] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:05:50.855267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:05:50.856980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:05:50.870126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e217f9d-28e5-45a3-b930-c59d0b7ce5dd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:05:50.875736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:05:50.876775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:05:50.877054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:05:50.877535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] PATH_INFO: `/v3/projects/e69159a8e91c449cb48e97b7aeb6a04b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:05:50.878853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69159a8e91c449cb48e97b7aeb6a04b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:05:50.880800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:05:50.935189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69159a8e91c449cb48e97b7aeb6a04b', 'request_id': 'req-1c312ca4-b893-477c-a1b4-d13a872234b7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.944185 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69159a8e91c449cb48e97b7aeb6a04b', 'request_id': 'req-1c312ca4-b893-477c-a1b4-d13a872234b7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.952314 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69159a8e91c449cb48e97b7aeb6a04b', 'request_id': 'req-1c312ca4-b893-477c-a1b4-d13a872234b7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.963482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] The token cache is being invalidate because project e69159a8e91c449cb48e97b7aeb6a04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:05:50.963775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.964427 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1c312ca4-b893-477c-a1b4-d13a872234b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:05:50.966238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1257/2475] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:05:50 2022] DELETE /identity/v3/projects/e69159a8e91c449cb48e97b7aeb6a04b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:06:00.567322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:00.960080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:24.662803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:24.663385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:24.663385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:24.681168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] MFA Rules not processed for user `f2217b3c134d453fbdcb14853eed4e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:24.683053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:24.751205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1219/2476] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:06:34.742472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=25 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:12.049193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa6bd-1615-4978-9963-a5a63f46bb03 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:07:12.049823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa6bd-1615-4978-9963-a5a63f46bb03 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:07:12.049823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa6bd-1615-4978-9963-a5a63f46bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:07:12.069162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0f1aa6bd-1615-4978-9963-a5a63f46bb03 None None] MFA Rules not processed for user `50ff2e53a17c4052a08ebe104034ab80`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:07:12.070404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f1aa6bd-1615-4978-9963-a5a63f46bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:12.136250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1258/2477] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:07:17.256955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:07:17.259771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:17.325880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b0063-800d-48e6-9777-add6ee5b59e4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:07:17.330072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:07:17.330762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:07:17.331050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:07:17.331327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:07:17.333536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:17.433484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:07:17.435317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:07:17.457537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1220/2478] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:07:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:07:17.491086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa6bd-1615-4978-9963-a5a63f46bb03 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:07:17.501650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa6bd-1615-4978-9963-a5a63f46bb03 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:07:17.505894 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:07:17.506623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:07:17.506924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:07:17.507206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:07:17.509335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:17.524398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:07:17.526129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:07:17.541459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1259/2479] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:07:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:07:27.454458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=66 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:27.534856 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=31 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:48.880935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:07:48.883829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:48.898976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f33ae2-f7df-4a05-963f-67425c9fc586 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:07:48.906211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:07:48.906797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:07:48.907081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:07:48.907363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:07:48.909284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:48.970093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:07:48.971809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:07:48.981391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1221/2480] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:07:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:07:50.454934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:07:50.468239 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c80bc0-acd1-4a5c-b124-43e57d5bbe75 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:07:50.473783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:07:50.474574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:07:50.474872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:07:50.475309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:07:50.477887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:50.493098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:07:50.494744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:07:50.508826 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1260/2481] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:07:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:07:58.976955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=28 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:59.226619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:07:59.240229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e380ba-2106-4514-afce-22930af972c9 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:07:59.246030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:07:59.246744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:07:59.247082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:07:59.247368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:07:59.249362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:07:59.259994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:07:59.261625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:07:59.269823 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1222/2482] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:07:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:08:00.502337 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:09.266677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:17.295895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:17.297368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:17.350764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:17.352397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:17.384408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bb48a-02c3-44be-9951-a5d0a3378ac9 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:17.389837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:17.390649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:17.390937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:17.391214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:17.393094 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:17.405017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:17.406639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:17.416684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1261/2483] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:08:17.426760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8174494-1028-4091-85c5-61265c169e6c service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:17.431792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:17.432676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:17.432954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:17.433320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] PATH_INFO: `/v3/users/50ff2e53a17c4052a08ebe104034ab80` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:17.435062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ff2e53a17c4052a08ebe104034ab80)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:17.436718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:17.485697 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ff2e53a17c4052a08ebe104034ab80'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.493060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ff2e53a17c4052a08ebe104034ab80'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.502326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ff2e53a17c4052a08ebe104034ab80'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.514838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ff2e53a17c4052a08ebe104034ab80'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.515520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64371a2e-2f84-4615-9119-b868f0414f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ff2e53a17c4052a08ebe104034ab80'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.521954 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1223/2484] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:08:17 2022] DELETE /identity/v3/users/50ff2e53a17c4052a08ebe104034ab80 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:17.713868 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:17.725440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de0bb-6c02-493a-a4cf-6c6e1c398d03 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:17.783023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:17.783899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:17.784182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:17.784464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] PATH_INFO: `/v3/projects/b579f36c6162451daa31ad27aa97a083` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:17.785623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b579f36c6162451daa31ad27aa97a083)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:17.787614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:17.836529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b579f36c6162451daa31ad27aa97a083', 'request_id': 'req-573678af-02d7-4d48-8a56-4925e3da50f0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.842984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b579f36c6162451daa31ad27aa97a083', 'request_id': 'req-573678af-02d7-4d48-8a56-4925e3da50f0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.852309 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b579f36c6162451daa31ad27aa97a083', 'request_id': 'req-573678af-02d7-4d48-8a56-4925e3da50f0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.863122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] The token cache is being invalidate because project b579f36c6162451daa31ad27aa97a083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:08:17.863413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.864059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-573678af-02d7-4d48-8a56-4925e3da50f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:17.865632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1262/2485] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:08:17 2022] DELETE /identity/v3/projects/b579f36c6162451daa31ad27aa97a083 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:17.870922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7be22-d7bf-4c71-aea7-3db910ca6a13 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:17.871222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7be22-d7bf-4c71-aea7-3db910ca6a13 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:17.871547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7be22-d7bf-4c71-aea7-3db910ca6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:17.890807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fee7be22-d7bf-4c71-aea7-3db910ca6a13 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:17.891948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fee7be22-d7bf-4c71-aea7-3db910ca6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:17.955158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1224/2486] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:17.963900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6cea-07ed-4083-874c-0ec9d25d5a60 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:17.964353 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6cea-07ed-4083-874c-0ec9d25d5a60 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:17.964782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6cea-07ed-4083-874c-0ec9d25d5a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:17.985293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-233e6cea-07ed-4083-874c-0ec9d25d5a60 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:17.986914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-233e6cea-07ed-4083-874c-0ec9d25d5a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:17.997385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1263/2487] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:18.003845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7be22-d7bf-4c71-aea7-3db910ca6a13 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:18.020508 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7be22-d7bf-4c71-aea7-3db910ca6a13 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:18.029605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:18.030305 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.030594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.030869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.031638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:08:18.031946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:18.033613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:18.046633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1225/2488] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:08:18.052840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e6cea-07ed-4083-874c-0ec9d25d5a60 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:18.063202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e6cea-07ed-4083-874c-0ec9d25d5a60 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:18.069212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:18.069873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.070188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.070468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.071156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:18.073064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:18.083744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:18.104134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1264/2489] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:08:18 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:08:18.108281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:18.119157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714eb5-90ab-4199-a996-9f15b61d1888 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:18.123389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:18.179313 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:18.179905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.180192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.180467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.181155 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:18.183139 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:18.203986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1226/2490] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:08:18 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:08:18.208262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:18.218870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947213c-5243-4450-8f36-b8d14595fdb3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:18.224544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:18.225218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.225505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.225785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.226554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:18.228204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:18.240032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1265/2491] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:08:18.244975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:18.256401 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924da8c-7f73-4cbe-ab8e-62b3f4002d53 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:18.262233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ad0e1-3f17-4f83-bffd-1d81088a51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:18.262961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad0e1-3f17-4f83-bffd-1d81088a51da admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.263349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad0e1-3f17-4f83-bffd-1d81088a51da admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.263502 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad0e1-3f17-4f83-bffd-1d81088a51da admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.264274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ad0e1-3f17-4f83-bffd-1d81088a51da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:18.266182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ad0e1-3f17-4f83-bffd-1d81088a51da admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:18.281525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1227/2492] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:08:18.283184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:18.294142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab68d1-2297-4396-b09c-11933685b027 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:18.299557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:18.300542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.300986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.301268 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] PATH_INFO: `/v3/projects/cdadb8f616f14e62b5277154035230e9/users/d90a73f12cae429d90555e1467e8c76e/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.317050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdadb8f616f14e62b5277154035230e9, user_id=d90a73f12cae429d90555e1467e8c76e, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:18.319785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:18.335128 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1266/2493] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:08:18 2022] PUT /identity/v3/projects/cdadb8f616f14e62b5277154035230e9/users/d90a73f12cae429d90555e1467e8c76e/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:18.346450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663107ed-f4ab-4114-b465-1c870711479f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.346746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663107ed-f4ab-4114-b465-1c870711479f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.347021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663107ed-f4ab-4114-b465-1c870711479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.375596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-663107ed-f4ab-4114-b465-1c870711479f None None] MFA Rules not processed for user `d90a73f12cae429d90555e1467e8c76e`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:18.376838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-663107ed-f4ab-4114-b465-1c870711479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:18.442834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1228/2494] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:18.453751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:18.455756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:18.514436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb70b7-556e-4113-9589-1a6cf9935aa3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:18.518220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:18.518875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:18.519164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:18.519443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:18.527853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:18.529329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:18.538653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1267/2495] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:08:19.612501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfebf3-9c0a-4337-8a39-40b94781b611 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:19.613465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfebf3-9c0a-4337-8a39-40b94781b611 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:19.613639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfebf3-9c0a-4337-8a39-40b94781b611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:19.640562 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1ccfebf3-9c0a-4337-8a39-40b94781b611 None None] MFA Rules not processed for user `010c4d5ba6b847b79d3127787db2ddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:19.642691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1ccfebf3-9c0a-4337-8a39-40b94781b611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:19.710248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1229/2496] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:28.534403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:29.701953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:31.832036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:31.833829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:31.913154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32537-aabc-4a5f-bac3-b950c72a7864 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:31.918741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f2e4a-b2b8-4b09-96a2-9b20c5994dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:31.919490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f2e4a-b2b8-4b09-96a2-9b20c5994dd3 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:31.919776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f2e4a-b2b8-4b09-96a2-9b20c5994dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:31.920053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f2e4a-b2b8-4b09-96a2-9b20c5994dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:31.921841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-961f2e4a-b2b8-4b09-96a2-9b20c5994dd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:31.934408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f2e4a-b2b8-4b09-96a2-9b20c5994dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:31.936028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f2e4a-b2b8-4b09-96a2-9b20c5994dd3 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:31.946896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1268/2497] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:08:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:08:41.089273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfebf3-9c0a-4337-8a39-40b94781b611 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:41.156285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfebf3-9c0a-4337-8a39-40b94781b611 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:41.161015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:41.161927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:41.162246 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:41.162529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] PATH_INFO: `/v3/users/d90a73f12cae429d90555e1467e8c76e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:41.163737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90a73f12cae429d90555e1467e8c76e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:41.165719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:41.232671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90a73f12cae429d90555e1467e8c76e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.243069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90a73f12cae429d90555e1467e8c76e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.253300 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90a73f12cae429d90555e1467e8c76e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.271277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90a73f12cae429d90555e1467e8c76e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.272369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90a73f12cae429d90555e1467e8c76e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.281552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1230/2498] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:08:41 2022] DELETE /identity/v3/users/d90a73f12cae429d90555e1467e8c76e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:41.286475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:41.286940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:41.287060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:41.304754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:41.305966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:41.367750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1269/2499] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:08:41.378836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:41.380667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:41.442856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3649edd-9182-4efc-9937-dfabaa4ab795 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:41.447175 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ae2e-d534-465f-9ba7-75e822ac9581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:41.447823 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ae2e-d534-465f-9ba7-75e822ac9581 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:41.448106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ae2e-d534-465f-9ba7-75e822ac9581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:41.448384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ae2e-d534-465f-9ba7-75e822ac9581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:41.459888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ae2e-d534-465f-9ba7-75e822ac9581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:41.461441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ae2e-d534-465f-9ba7-75e822ac9581 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:41.471475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1231/2500] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:08:41.757501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:41.759136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:41.771500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5a399-ac74-4a75-82a3-7dfbcfd3549f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:41.777587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:41.778479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:41.778846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:41.779180 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] PATH_INFO: `/v3/projects/cdadb8f616f14e62b5277154035230e9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:41.780650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdadb8f616f14e62b5277154035230e9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:41.782815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:41.833119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdadb8f616f14e62b5277154035230e9', 'request_id': 'req-97014096-72c2-4906-ac17-a047321db74f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.839491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdadb8f616f14e62b5277154035230e9', 'request_id': 'req-97014096-72c2-4906-ac17-a047321db74f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.848126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdadb8f616f14e62b5277154035230e9', 'request_id': 'req-97014096-72c2-4906-ac17-a047321db74f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.858851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] The token cache is being invalidate because project cdadb8f616f14e62b5277154035230e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:08:41.859135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.859789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-97014096-72c2-4906-ac17-a047321db74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:08:41.861321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1270/2501] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:08:41 2022] DELETE /identity/v3/projects/cdadb8f616f14e62b5277154035230e9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:41.866857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9883-555a-4618-8310-15fb1f4bff7c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:41.867584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9883-555a-4618-8310-15fb1f4bff7c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:41.867870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9883-555a-4618-8310-15fb1f4bff7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:41.886791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0a8c9883-555a-4618-8310-15fb1f4bff7c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:41.888053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0a8c9883-555a-4618-8310-15fb1f4bff7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:41.905700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:41.951332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1232/2502] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:41.959573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dccb7-0cd5-4021-b0b0-2cc660148f26 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:41.959865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dccb7-0cd5-4021-b0b0-2cc660148f26 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:41.960151 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dccb7-0cd5-4021-b0b0-2cc660148f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:41.979895 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e61dccb7-0cd5-4021-b0b0-2cc660148f26 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:41.981131 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e61dccb7-0cd5-4021-b0b0-2cc660148f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:41.990621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1271/2503] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:41.995763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9883-555a-4618-8310-15fb1f4bff7c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:42.010417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9883-555a-4618-8310-15fb1f4bff7c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:42.016724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:42.017392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.017682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.017955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.018723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:08:42.019033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:42.020652 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:42.034461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1233/2504] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:08:42.040359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dccb7-0cd5-4021-b0b0-2cc660148f26 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:42.044899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:42.050671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dccb7-0cd5-4021-b0b0-2cc660148f26 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:42.059209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:42.060009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.060460 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.060776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.061820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:42.065424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:42.110708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1272/2505] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:08:42 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:08:42.115362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:42.126239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6afe0-79ce-46d0-8811-45b9234ca821 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:42.186835 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:42.187752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.188036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.188312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.189010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:42.191074 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:42.213303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1234/2506] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:08:42 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:08:42.217479 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:42.228595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90079-fc60-45e1-8284-32d7c0d0152c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:42.233967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:42.234671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.234961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.235238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.236040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:42.238031 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:42.248673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1273/2507] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:08:42.254000 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:42.264707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d9b14-b871-452f-94ff-28fa4f150b41 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:42.269839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7822c1-d9f1-40ed-85b1-e98eb2b5d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:42.270538 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7822c1-d9f1-40ed-85b1-e98eb2b5d932 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.270827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7822c1-d9f1-40ed-85b1-e98eb2b5d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.271243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7822c1-d9f1-40ed-85b1-e98eb2b5d932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.271977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7822c1-d9f1-40ed-85b1-e98eb2b5d932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:42.273589 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7822c1-d9f1-40ed-85b1-e98eb2b5d932 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:42.283603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1235/2508] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:08:42.288236 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:42.298799 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baceec-86c1-44e1-8a02-e373a08390a9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:42.304178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:42.305099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.305378 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.305651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] PATH_INFO: `/v3/projects/2fd9de1783e54cafadd25ecc97876288/users/62f5e92899b84d5594a34643b662d233/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.321198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd9de1783e54cafadd25ecc97876288, user_id=62f5e92899b84d5594a34643b662d233, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:42.324003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:42.342051 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1274/2509] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:08:42 2022] PUT /identity/v3/projects/2fd9de1783e54cafadd25ecc97876288/users/62f5e92899b84d5594a34643b662d233/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:42.347474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c934928-f332-4910-ac73-01644c1cf682 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.347759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c934928-f332-4910-ac73-01644c1cf682 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.348050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c934928-f332-4910-ac73-01644c1cf682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.367487 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4c934928-f332-4910-ac73-01644c1cf682 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:42.368719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4c934928-f332-4910-ac73-01644c1cf682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:42.435798 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1236/2510] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:42.445558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:42.447434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:42.506160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde3543-88ca-472a-bde1-691698d86500 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:42.510364 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:42.511009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:42.511300 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:42.511590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:42.521085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:42.522498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:42.531884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1275/2511] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:08:46.384075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14074503-b94d-4669-8852-d97dc5e021c1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:46.384618 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14074503-b94d-4669-8852-d97dc5e021c1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:46.384807 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14074503-b94d-4669-8852-d97dc5e021c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:46.418285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-14074503-b94d-4669-8852-d97dc5e021c1 None None] MFA Rules not processed for user `62f5e92899b84d5594a34643b662d233`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:46.419439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-14074503-b94d-4669-8852-d97dc5e021c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:46.438989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:46.492997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1237/2512] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:46.497727 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:46.509382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76325f-6443-4a25-8ace-cc6d61ba6783 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:46.514475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:46.515147 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:46.515610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:46.515728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:46.516423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:46.518429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:46.553543 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1276/2513] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:08:46 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:08:46.557620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14074503-b94d-4669-8852-d97dc5e021c1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:46.568748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14074503-b94d-4669-8852-d97dc5e021c1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:46.665226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:46.665935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:46.666268 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:46.666554 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:46.667261 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:46.669239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:46.696654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1238/2514] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:08:46 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:08:46.698452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:46.709413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4044d9-1887-4dc4-a6bf-0f947b2bb5b1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:46.714957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:46.715645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:46.715924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:46.716199 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:46.716929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:46.718595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:46.733595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1277/2515] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:08:46.738173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:46.748953 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236b0f-204f-4821-9c91-a15c72c2d30d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:46.753754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:46.754765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:46.755044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:46.755320 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] PATH_INFO: `/v3/projects/f9c9aa090565493d9d388b4723e12338/users/c1325c291f9f4db0a9b122b3aee2c9af/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:46.772476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c9aa090565493d9d388b4723e12338, user_id=c1325c291f9f4db0a9b122b3aee2c9af, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:46.775617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:46.792722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1239/2516] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:08:46 2022] PUT /identity/v3/projects/f9c9aa090565493d9d388b4723e12338/users/c1325c291f9f4db0a9b122b3aee2c9af/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:46.796940 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:46.807790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c866a74-0ec6-40ab-a164-fc9094f3b245 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:46.869078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2e74-bcf6-4f92-bc7a-08ba22f5f375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:46.869767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2e74-bcf6-4f92-bc7a-08ba22f5f375 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:46.870052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2e74-bcf6-4f92-bc7a-08ba22f5f375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:46.870360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2e74-bcf6-4f92-bc7a-08ba22f5f375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:46.871084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2e74-bcf6-4f92-bc7a-08ba22f5f375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:46.872733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2e74-bcf6-4f92-bc7a-08ba22f5f375 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:46.883637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1278/2517] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:08:46.887738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:46.898785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eba9fa-5db9-40cf-b434-1f4b0c19064a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:46.903657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:46.904577 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:46.904864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:46.905142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] PATH_INFO: `/v3/projects/f9c9aa090565493d9d388b4723e12338/users/c1325c291f9f4db0a9b122b3aee2c9af/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:46.907161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c9aa090565493d9d388b4723e12338, user_id=c1325c291f9f4db0a9b122b3aee2c9af, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:46.909837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:46.921120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1240/2518] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:08:46 2022] PUT /identity/v3/projects/f9c9aa090565493d9d388b4723e12338/users/c1325c291f9f4db0a9b122b3aee2c9af/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:08:51.304104 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:51.304672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:51.304672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:51.311178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:51.335419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] MFA Rules not processed for user `c1325c291f9f4db0a9b122b3aee2c9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:08:51.336643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:51.409282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1279/2519] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:08:51.425894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:08:51.427950 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:08:51.512923 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb764d8-2b97-4bc6-aca0-ee80e048ac6a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:08:51.518803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:08:51.519469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:08:51.519748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:08:51.520021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:08:51.525551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:51.585178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:08:51.586924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:08:51.596469 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1241/2520] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:08:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:00.039220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:00.040909 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:00.058085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35f35-1c9b-44f9-b1c2-e9fb5f5921e5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:00.067171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d66436-73b9-48a8-b960-f3ae9f2dee6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:00.068046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d66436-73b9-48a8-b960-f3ae9f2dee6c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:00.068411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d66436-73b9-48a8-b960-f3ae9f2dee6c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:00.068774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d66436-73b9-48a8-b960-f3ae9f2dee6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:00.071921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-04d66436-73b9-48a8-b960-f3ae9f2dee6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:00.293343 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d66436-73b9-48a8-b960-f3ae9f2dee6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:00.294980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d66436-73b9-48a8-b960-f3ae9f2dee6c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:00.304697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1280/2521] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:00.500861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:00.511956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5caae-e200-4276-aacf-5e0514ab5225 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:00.517614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:00.518304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:00.518575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:00.518847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:00.520585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:00.596759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:00.598563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:00.609267 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1242/2522] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:10.300016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=61 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:10.603857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=52 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:11.686593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8754-8f06-40dd-b5ee-a73326629d90 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:11.687186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8754-8f06-40dd-b5ee-a73326629d90 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:11.687186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8754-8f06-40dd-b5ee-a73326629d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:11.748786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d6ed8754-8f06-40dd-b5ee-a73326629d90 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:09:11.750134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6ed8754-8f06-40dd-b5ee-a73326629d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:11.814567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1281/2523] 10.222.0.58 () {58 vars in 967 bytes} [Fri Jun 3 13:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:09:11.857379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:11.858880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:11.953086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb4d6-f39b-44d8-a709-8d34488a5eea service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:11.958412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3d6bc-cf57-4b6d-9998-977e22488193 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:11.959061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d6bc-cf57-4b6d-9998-977e22488193 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:11.959341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d6bc-cf57-4b6d-9998-977e22488193 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:11.959615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d6bc-cf57-4b6d-9998-977e22488193 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:11.968135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3d6bc-cf57-4b6d-9998-977e22488193 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:11.969814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3d6bc-cf57-4b6d-9998-977e22488193 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:11.978905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1243/2524] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 13:09:12.391346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed8754-8f06-40dd-b5ee-a73326629d90 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:12.474889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed8754-8f06-40dd-b5ee-a73326629d90 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:12.482053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592e50e-35fe-4c4d-8d59-3c9217f50a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:12.483021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e50e-35fe-4c4d-8d59-3c9217f50a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:12.483386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e50e-35fe-4c4d-8d59-3c9217f50a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:12.483756 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e50e-35fe-4c4d-8d59-3c9217f50a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:12.486140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9592e50e-35fe-4c4d-8d59-3c9217f50a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:12.568056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592e50e-35fe-4c4d-8d59-3c9217f50a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:12.569915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592e50e-35fe-4c4d-8d59-3c9217f50a30 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:12.582260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1282/2525] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:15.947366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:15.951629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:15.954521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:15.979491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] MFA Rules not processed for user `f2217b3c134d453fbdcb14853eed4e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:09:15.980944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:15.988657 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1244/2526] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:09:16.419365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111711-ce9c-4823-bde5-5abc4c7c3b32 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:16.419861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111711-ce9c-4823-bde5-5abc4c7c3b32 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:16.419950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111711-ce9c-4823-bde5-5abc4c7c3b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:16.438859 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bb111711-ce9c-4823-bde5-5abc4c7c3b32 None None] MFA Rules not processed for user `62f5e92899b84d5594a34643b662d233`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:09:16.440222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bb111711-ce9c-4823-bde5-5abc4c7c3b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:16.451553 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1283/2527] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:09:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:09:16.572676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:16.574424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:16.587755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b173b33-a2e7-40ad-8b24-907530d0d11f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:16.591661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:16.592317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:16.592598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:16.592869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:16.595351 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:16.606276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:16.607715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:16.617467 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1245/2528] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:09:17.239193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb111711-ce9c-4823-bde5-5abc4c7c3b32 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:17.250338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb111711-ce9c-4823-bde5-5abc4c7c3b32 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:17.255861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c059edd-e1e0-4c46-885b-57794c6378e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:17.256559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059edd-e1e0-4c46-885b-57794c6378e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:17.256806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059edd-e1e0-4c46-885b-57794c6378e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:17.257084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059edd-e1e0-4c46-885b-57794c6378e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:17.259233 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c059edd-e1e0-4c46-885b-57794c6378e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:17.266688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:17.271987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c059edd-e1e0-4c46-885b-57794c6378e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:17.273967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c059edd-e1e0-4c46-885b-57794c6378e8 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:17.285225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1284/2529] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:17.310362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:17.311877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:17.401516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce77e9-8f15-4ffa-a96c-8eba8e4874fc service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:17.401516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777c6a-ee44-4789-9408-d1d4af934a3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:17.401516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777c6a-ee44-4789-9408-d1d4af934a3b service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:17.401516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777c6a-ee44-4789-9408-d1d4af934a3b service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:17.401936 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777c6a-ee44-4789-9408-d1d4af934a3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:17.403849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bf777c6a-ee44-4789-9408-d1d4af934a3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:17.417306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf777c6a-ee44-4789-9408-d1d4af934a3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:17.419013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf777c6a-ee44-4789-9408-d1d4af934a3b service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:17.429539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1246/2530] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:22.028938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d593a92-a94c-41c2-99e4-f4d849c2887a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:22.029541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d593a92-a94c-41c2-99e4-f4d849c2887a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:22.029541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d593a92-a94c-41c2-99e4-f4d849c2887a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:22.031887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1285/2531] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:09:22.062872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27bc2-f1db-4648-9624-76816aecd3be None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:22.064076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27bc2-f1db-4648-9624-76816aecd3be None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:22.064416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27bc2-f1db-4648-9624-76816aecd3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:22.110860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d593a92-a94c-41c2-99e4-f4d849c2887a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:22.113280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3d593a92-a94c-41c2-99e4-f4d849c2887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:22.135161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d593a92-a94c-41c2-99e4-f4d849c2887a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:22.143809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:22.145035 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:22.145256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8fa27bc2-f1db-4648-9624-76816aecd3be None None] MFA Rules not processed for user `7694db301bef4371a85993f54ad55d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:09:22.145975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:22.146783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8fa27bc2-f1db-4648-9624-76816aecd3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:22.147174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] PATH_INFO: `/v3/users/94dbfb6cf680454f883d43796f05c799` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:22.149171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dbfb6cf680454f883d43796f05c799)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:22.151959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:22.160122 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1247/2532] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:09:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:09:22.172222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27bc2-f1db-4648-9624-76816aecd3be None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:22.183927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27bc2-f1db-4648-9624-76816aecd3be None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:22.189801 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:22.190553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:22.190912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:22.191222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:22.201381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:22.202977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:22.215605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1248/2533] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:09:22.231519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dbfb6cf680454f883d43796f05c799'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.241568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dbfb6cf680454f883d43796f05c799'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.252219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dbfb6cf680454f883d43796f05c799'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.264836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dbfb6cf680454f883d43796f05c799'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.265617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dbfb6cf680454f883d43796f05c799'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.271961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1286/2534] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:09:22 2022] DELETE /identity/v3/users/94dbfb6cf680454f883d43796f05c799 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:09:22.507952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:22.521879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443adfb-26ce-48e7-819c-6371981fc8dc service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:22.526146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:22.598829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:22.599719 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:22.600004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:22.600281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] PATH_INFO: `/v3/projects/80d06506691e4947b14192431bed4453` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:22.601473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d06506691e4947b14192431bed4453)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:22.603484 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:22.651319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d06506691e4947b14192431bed4453', 'request_id': 'req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.657682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d06506691e4947b14192431bed4453', 'request_id': 'req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.667388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d06506691e4947b14192431bed4453', 'request_id': 'req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.678036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] The token cache is being invalidate because project 80d06506691e4947b14192431bed4453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:09:22.678366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.679054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.680649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1249/2535] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:09:22 2022] DELETE /identity/v3/projects/80d06506691e4947b14192431bed4453 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:09:22.685120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:22.686874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:22.701539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b537b2-c5f2-4874-85f8-bef053c0a73c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:22.770539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:22.771328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:22.771603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:22.771874 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] PATH_INFO: `/v3/users/b3729f6d1d97450c88bc3004a70d88f1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:22.773210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3729f6d1d97450c88bc3004a70d88f1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:22.775189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:22.825637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3729f6d1d97450c88bc3004a70d88f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.832985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3729f6d1d97450c88bc3004a70d88f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.843798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3729f6d1d97450c88bc3004a70d88f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.848804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:22.857862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3729f6d1d97450c88bc3004a70d88f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.858588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3729f6d1d97450c88bc3004a70d88f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:22.865018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1287/2536] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:09:22 2022] DELETE /identity/v3/users/b3729f6d1d97450c88bc3004a70d88f1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:09:23.045433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:23.047187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:23.059967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92f9d-eb5c-407d-89ad-10cccf24fc1f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:23.122519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:23.123397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:23.123681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:23.123963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] PATH_INFO: `/v3/projects/224c2871117145cf9054e9e3dc1bc547` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:23.125166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224c2871117145cf9054e9e3dc1bc547)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:23.127140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:23.168951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:23.176483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224c2871117145cf9054e9e3dc1bc547', 'request_id': 'req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:23.183204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224c2871117145cf9054e9e3dc1bc547', 'request_id': 'req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:23.192134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224c2871117145cf9054e9e3dc1bc547', 'request_id': 'req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:23.203225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] The token cache is being invalidate because project 224c2871117145cf9054e9e3dc1bc547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:09:23.203515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:23.204153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:23.205720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1250/2537] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:09:23 2022] DELETE /identity/v3/projects/224c2871117145cf9054e9e3dc1bc547 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:09:27.410891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:27.412590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:27.491140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef926199-eea2-4765-877f-45965ed067a0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:27.559348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:27.560017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:27.560305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:27.560588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:27.562451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:27.574409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:27.576001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:27.586690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1288/2538] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:33.200396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:37.582222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=2,keystone:SELECT=67 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:37.962878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:37.964515 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:38.027078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22a4d8-8aae-4e5e-9df7-23fe4571e248 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:38.031055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:38.031702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:38.031981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:38.032253 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:38.034236 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:38.096997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:38.098548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:38.107981 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1251/2539] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:48.103965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=50 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:55.788386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:55.789961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:55.802610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031b267-a2e4-49db-a72e-08bd0a747c0c service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:55.806846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:55.807432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:55.807723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:55.808002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:55.809806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:55.876789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:55.878262 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:55.888375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1289/2540] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:09:58.862013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:58.863509 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:58.879215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc5d8-7802-4c12-89bd-5efda5f60952 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:58.884125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:58.885036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:58.885335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:58.885815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] PATH_INFO: `/v3/users/010c4d5ba6b847b79d3127787db2ddd6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:58.887021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010c4d5ba6b847b79d3127787db2ddd6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:58.888935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:58.945858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010c4d5ba6b847b79d3127787db2ddd6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:58.953280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010c4d5ba6b847b79d3127787db2ddd6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:58.963339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010c4d5ba6b847b79d3127787db2ddd6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:58.975642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010c4d5ba6b847b79d3127787db2ddd6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:58.976280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d99bb22a-dd49-455e-a186-ac41036f0045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010c4d5ba6b847b79d3127787db2ddd6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:58.982684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1252/2541] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:09:58 2022] DELETE /identity/v3/users/010c4d5ba6b847b79d3127787db2ddd6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:09:59.165755 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.176666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044322b2-95b7-43a3-9ccb-d050309fbcee service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.235565 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.236436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.236718 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.236991 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] PATH_INFO: `/v3/projects/45170704be9845929be13eb3a96eeb07` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.238189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=45170704be9845929be13eb3a96eeb07)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.240474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.289923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45170704be9845929be13eb3a96eeb07', 'request_id': 'req-b43faad4-b741-42f2-b33b-c65c6d85f65a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:59.296342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45170704be9845929be13eb3a96eeb07', 'request_id': 'req-b43faad4-b741-42f2-b33b-c65c6d85f65a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:59.305662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45170704be9845929be13eb3a96eeb07', 'request_id': 'req-b43faad4-b741-42f2-b33b-c65c6d85f65a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:59.316432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] The token cache is being invalidate because project 45170704be9845929be13eb3a96eeb07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:09:59.316721 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:59.317362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b43faad4-b741-42f2-b33b-c65c6d85f65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:09:59.318956 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1290/2542] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:09:59 2022] DELETE /identity/v3/projects/45170704be9845929be13eb3a96eeb07 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:09:59.324177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dc58f-af36-4553-a05b-0b8706bad778 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.324462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dc58f-af36-4553-a05b-0b8706bad778 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.324758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dc58f-af36-4553-a05b-0b8706bad778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.342731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e73dc58f-af36-4553-a05b-0b8706bad778 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:09:59.343956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e73dc58f-af36-4553-a05b-0b8706bad778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:59.406551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1253/2543] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:09:59.415381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45d92f-baf8-4a57-89b9-a3a96b6f821d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.415671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45d92f-baf8-4a57-89b9-a3a96b6f821d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.415949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45d92f-baf8-4a57-89b9-a3a96b6f821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.434426 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0a45d92f-baf8-4a57-89b9-a3a96b6f821d None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:09:59.435642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0a45d92f-baf8-4a57-89b9-a3a96b6f821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:59.444539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1291/2544] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:09:59.449107 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dc58f-af36-4553-a05b-0b8706bad778 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.459507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dc58f-af36-4553-a05b-0b8706bad778 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.464872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.465536 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.465838 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.466136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.466870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:09:59.467178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.468794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.480656 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1254/2545] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:09:59.484933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45d92f-baf8-4a57-89b9-a3a96b6f821d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.495061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45d92f-baf8-4a57-89b9-a3a96b6f821d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.501093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.501743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.501986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.502323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.503008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.504907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.520067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:59.541682 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1292/2546] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:09:59 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:09:59.541903 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.552037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3079af-cd6d-4dae-a8fb-4d57206c150a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.610543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.611218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.611498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.611772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.612474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.614827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.621570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:59.638525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1255/2547] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:09:59 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:09:59.642688 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.653591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed347f0-3458-41c5-9e3e-3c6027c5a048 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.659231 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.659889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.660196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.660581 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.661311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.662959 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.673716 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1293/2548] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:09:59.677643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.688299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee37bf0-7272-4200-b1f6-560b912ae382 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.693427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eff542-21bd-4244-8e04-e74f937e33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.694090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff542-21bd-4244-8e04-e74f937e33bf admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.694408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff542-21bd-4244-8e04-e74f937e33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.694671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff542-21bd-4244-8e04-e74f937e33bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.695409 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eff542-21bd-4244-8e04-e74f937e33bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.697010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eff542-21bd-4244-8e04-e74f937e33bf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.707462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1256/2549] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:09:59.711684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.721798 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b0d23-21d1-4791-81bc-e3f52313c727 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.726677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.727561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.727847 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.728125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] PATH_INFO: `/v3/projects/020ed9813c614d2eae9568ba85728136/users/49b596abb9a5466595eec1a8fb25d5a1/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.743414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020ed9813c614d2eae9568ba85728136, user_id=49b596abb9a5466595eec1a8fb25d5a1, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.746089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.763138 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1294/2550] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:09:59 2022] PUT /identity/v3/projects/020ed9813c614d2eae9568ba85728136/users/49b596abb9a5466595eec1a8fb25d5a1/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:09:59.768460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade757-2485-4486-819e-2472a47c6604 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.768751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade757-2485-4486-819e-2472a47c6604 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.769028 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade757-2485-4486-819e-2472a47c6604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.788142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-08ade757-2485-4486-819e-2472a47c6604 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:09:59.789343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-08ade757-2485-4486-819e-2472a47c6604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:59.851783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1257/2551] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:09:59.861762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:09:59.864040 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:09:59.924545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48b06-4aa5-4f22-9d13-85a1b195d577 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:09:59.928644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:09:59.929284 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:09:59.929569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:09:59.929846 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:09:59.939711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:09:59.941156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:09:59.951171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1295/2552] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:10:04.166960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb7784-37ab-4aaf-9bc6-ba1195995f99 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:10:04.167479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb7784-37ab-4aaf-9bc6-ba1195995f99 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:10:04.167575 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb7784-37ab-4aaf-9bc6-ba1195995f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:10:04.213095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-60bb7784-37ab-4aaf-9bc6-ba1195995f99 None None] MFA Rules not processed for user `49b596abb9a5466595eec1a8fb25d5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:10:04.215408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-60bb7784-37ab-4aaf-9bc6-ba1195995f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:10:04.295804 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1258/2553] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:10:04.310570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:10:04.312045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:10:04.392072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4ecb0-0aa5-49c5-a1ea-c8cf075a0403 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:10:04.399019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:10:04.399689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:10:04.399970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:10:04.400246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:10:04.409352 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:10:04.410961 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:10:04.420876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1296/2554] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:10:05.773543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f117933-1158-4b8f-96d5-06bf04e853b2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:10:05.774075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f117933-1158-4b8f-96d5-06bf04e853b2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:10:05.774206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f117933-1158-4b8f-96d5-06bf04e853b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:10:05.792076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1f117933-1158-4b8f-96d5-06bf04e853b2 None None] MFA Rules not processed for user `49b596abb9a5466595eec1a8fb25d5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:10:05.793462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1f117933-1158-4b8f-96d5-06bf04e853b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:10:05.800873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1259/2555] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:10:14.416463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:15.786608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:01.701235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:11:01.702941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:11:01.772886 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51405-51fb-4aa4-a7d5-0edc4cb020de service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:11:01.778297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35ba2-ff1e-461c-9bf5-27da44930884 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:11:01.778960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35ba2-ff1e-461c-9bf5-27da44930884 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:11:01.779302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35ba2-ff1e-461c-9bf5-27da44930884 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:11:01.779584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35ba2-ff1e-461c-9bf5-27da44930884 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:11:01.781392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62f35ba2-ff1e-461c-9bf5-27da44930884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:11:01.793260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35ba2-ff1e-461c-9bf5-27da44930884 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:11:01.794976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35ba2-ff1e-461c-9bf5-27da44930884 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:11:01.805503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1297/2556] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:11:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:11:05.337606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:11:05.338165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:11:05.338165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:11:05.356413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] MFA Rules not processed for user `f2217b3c134d453fbdcb14853eed4e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:11:05.357651 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:11:05.421464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1260/2557] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:11:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:11:11.801142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=32 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:15.411902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=25 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:59.649210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a46bf-c828-4f06-ada7-638e21b8d3d5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:11:59.649740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a46bf-c828-4f06-ada7-638e21b8d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:11:59.649740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a46bf-c828-4f06-ada7-638e21b8d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:11:59.669654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-952a46bf-c828-4f06-ada7-638e21b8d3d5 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:11:59.670976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-952a46bf-c828-4f06-ada7-638e21b8d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:11:59.729520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1298/2558] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:11:59.785849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:11:59.787363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:11:59.867412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8654-75b7-4a9e-8732-e26ec2e7dc8d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:11:59.872718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cefcac-7896-40d0-b2c9-52cff4e160cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:11:59.873380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cefcac-7896-40d0-b2c9-52cff4e160cf service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:11:59.873667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cefcac-7896-40d0-b2c9-52cff4e160cf service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:11:59.873946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cefcac-7896-40d0-b2c9-52cff4e160cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:11:59.883010 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cefcac-7896-40d0-b2c9-52cff4e160cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:11:59.884560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cefcac-7896-40d0-b2c9-52cff4e160cf service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:11:59.893974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1261/2559] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:02.380235 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803bdf-f867-4335-b512-5c709a11fa7b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:02.380749 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803bdf-f867-4335-b512-5c709a11fa7b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:02.380854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803bdf-f867-4335-b512-5c709a11fa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:02.399876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0f803bdf-f867-4335-b512-5c709a11fa7b None None] MFA Rules not processed for user `62f5e92899b84d5594a34643b662d233`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:02.401117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f803bdf-f867-4335-b512-5c709a11fa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:02.463650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1299/2560] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:09.890378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=32 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:12.455000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=50 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:15.593030 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2d306-cd3d-4e80-b046-20e83512a811 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:15.593599 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2d306-cd3d-4e80-b046-20e83512a811 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:15.593715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2d306-cd3d-4e80-b046-20e83512a811 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:15.595281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1262/2561] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:12:15.602447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549585be-5720-44b8-8569-8a0be68c2144 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:15.602983 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549585be-5720-44b8-8569-8a0be68c2144 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:15.603083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549585be-5720-44b8-8569-8a0be68c2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:15.641912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-549585be-5720-44b8-8569-8a0be68c2144 None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:15.643182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-549585be-5720-44b8-8569-8a0be68c2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:15.653362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1300/2562] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:15.666152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2d306-cd3d-4e80-b046-20e83512a811 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:15.668298 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-deb2d306-cd3d-4e80-b046-20e83512a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:15.749761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2d306-cd3d-4e80-b046-20e83512a811 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:15.753368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3e647-190c-4629-b87c-baa16dbaa88a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:15.754006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3e647-190c-4629-b87c-baa16dbaa88a service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:15.754319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3e647-190c-4629-b87c-baa16dbaa88a service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:15.754588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3e647-190c-4629-b87c-baa16dbaa88a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:15.765090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3e647-190c-4629-b87c-baa16dbaa88a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:15.766567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3e647-190c-4629-b87c-baa16dbaa88a service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:15.777750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1263/2563] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:12:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:12:15.855616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8c09-6df5-4129-b000-57f406ab11f6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:15.855908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8c09-6df5-4129-b000-57f406ab11f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:15.856189 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8c09-6df5-4129-b000-57f406ab11f6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:15.857583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1301/2564] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:12:15.862501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72321-73e2-4cc8-872f-6ff36cd7f5ec None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:15.862797 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72321-73e2-4cc8-872f-6ff36cd7f5ec None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:15.863077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72321-73e2-4cc8-872f-6ff36cd7f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:15.883679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0cf72321-73e2-4cc8-872f-6ff36cd7f5ec None None] MFA Rules not processed for user `2fa3a98382cd4b04bb384bbc2ab3a598`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:15.884902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0cf72321-73e2-4cc8-872f-6ff36cd7f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:15.892725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1264/2565] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:15.908770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8c09-6df5-4129-b000-57f406ab11f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:15.910834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a1b8c09-6df5-4129-b000-57f406ab11f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:15.925921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8c09-6df5-4129-b000-57f406ab11f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:15.930008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70365bb-36b0-4082-8b10-dc8891abf10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:15.930732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70365bb-36b0-4082-8b10-dc8891abf10f service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:15.931017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70365bb-36b0-4082-8b10-dc8891abf10f service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:15.931296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70365bb-36b0-4082-8b10-dc8891abf10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:15.938777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70365bb-36b0-4082-8b10-dc8891abf10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:15.940226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70365bb-36b0-4082-8b10-dc8891abf10f service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:15.948183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1302/2566] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:12:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:12:16.047274 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01645-459e-4eb5-b965-fe1b8d09897a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:16.047648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01645-459e-4eb5-b965-fe1b8d09897a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:16.047993 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01645-459e-4eb5-b965-fe1b8d09897a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:16.049541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1265/2567] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:12:16.055280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091584-1685-4755-9a74-6fadb9083e12 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:16.055545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091584-1685-4755-9a74-6fadb9083e12 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:16.055824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091584-1685-4755-9a74-6fadb9083e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:16.075101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-91091584-1685-4755-9a74-6fadb9083e12 None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:16.076369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91091584-1685-4755-9a74-6fadb9083e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:16.087376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1303/2568] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:12:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:16.099810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd01645-459e-4eb5-b965-fe1b8d09897a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:16.111938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd01645-459e-4eb5-b965-fe1b8d09897a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:16.116249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:16.116982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:16.117624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:16.117973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:16.129329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:16.131040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:16.143982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1266/2569] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:12:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:12:17.971206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091584-1685-4755-9a74-6fadb9083e12 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:17.981890 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091584-1685-4755-9a74-6fadb9083e12 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:17.986401 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35d599-4474-4428-ab9e-0c5392bdfc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:17.987054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35d599-4474-4428-ab9e-0c5392bdfc55 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:17.987336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35d599-4474-4428-ab9e-0c5392bdfc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:17.987640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35d599-4474-4428-ab9e-0c5392bdfc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:17.990018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da35d599-4474-4428-ab9e-0c5392bdfc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:18.004709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35d599-4474-4428-ab9e-0c5392bdfc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:18.006230 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35d599-4474-4428-ab9e-0c5392bdfc55 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:18.031238 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1304/2570] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:12:18.628611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:18.638432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d723c-d451-4bd7-9d3e-76ce220635dc service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:18.642716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:18.643374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:18.643661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:18.643940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:18.645865 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:18.660759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:18.662247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:18.674150 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1267/2571] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:12:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:12:19.078195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff883ee-a57d-488e-b292-cf1d90aad3c0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:19.078693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff883ee-a57d-488e-b292-cf1d90aad3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:19.078788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff883ee-a57d-488e-b292-cf1d90aad3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:19.096466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4ff883ee-a57d-488e-b292-cf1d90aad3c0 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:19.097600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ff883ee-a57d-488e-b292-cf1d90aad3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:19.104824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1305/2572] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:12:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:19.117255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:19.128724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5430a60-2721-437f-ae3f-5049d82ca915 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:19.134145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:19.134817 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:19.135102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:19.135592 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:19.144068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:19.145686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:19.155977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1268/2573] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:29.091277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=27 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:29.151964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=56 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:45.154121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31951-5b55-45de-98f0-279bde698d06 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:45.154683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31951-5b55-45de-98f0-279bde698d06 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:45.154683 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31951-5b55-45de-98f0-279bde698d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:45.176072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-14c31951-5b55-45de-98f0-279bde698d06 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:45.177499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14c31951-5b55-45de-98f0-279bde698d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:45.188431 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1306/2574] 10.222.0.58 () {58 vars in 967 bytes} [Fri Jun 3 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:45.204027 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:45.216495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cf22-c9de-4227-aaf4-3f92c6a135ef service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:45.223043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:45.223704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:45.223989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:45.224265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:45.233974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:45.235601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:45.244649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1269/2575] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:12:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:53.899034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31951-5b55-45de-98f0-279bde698d06 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:53.908922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31951-5b55-45de-98f0-279bde698d06 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:53.912902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:53.913550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:53.913837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:53.914142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:53.915988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:53.927884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:53.929315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:53.939203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1307/2576] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:12:55.241294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:57.148398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:57.149969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:57.166867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51349b3-4eb8-4bf4-b676-8ac3f3041b10 service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:57.172710 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:57.173608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:57.173890 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:57.174223 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] PATH_INFO: `/v3/users/f2217b3c134d453fbdcb14853eed4e3b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:57.188581 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2217b3c134d453fbdcb14853eed4e3b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:57.190563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:57.240621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2217b3c134d453fbdcb14853eed4e3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.247612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2217b3c134d453fbdcb14853eed4e3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.257322 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2217b3c134d453fbdcb14853eed4e3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.271006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2217b3c134d453fbdcb14853eed4e3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.271791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e01fce87-14b2-4cf8-8a30-5f0bb9286ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2217b3c134d453fbdcb14853eed4e3b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.278447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1270/2577] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:12:57 2022] DELETE /identity/v3/users/f2217b3c134d453fbdcb14853eed4e3b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:12:57.467878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:57.479350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc3a2f-0418-4c9d-a97f-382e4e04a973 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:57.541726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:57.542642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:57.542945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:57.543224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] PATH_INFO: `/v3/projects/b6cc7be84d074c319f6c2d8628e76f52` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:57.555782 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cc7be84d074c319f6c2d8628e76f52)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:57.557732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:57.605168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cc7be84d074c319f6c2d8628e76f52', 'request_id': 'req-4010a33b-6179-4b02-a84c-41e226047147'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.611579 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cc7be84d074c319f6c2d8628e76f52', 'request_id': 'req-4010a33b-6179-4b02-a84c-41e226047147'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.622613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cc7be84d074c319f6c2d8628e76f52', 'request_id': 'req-4010a33b-6179-4b02-a84c-41e226047147'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.633005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] The token cache is being invalidate because project b6cc7be84d074c319f6c2d8628e76f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:12:57.633296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.633970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4010a33b-6179-4b02-a84c-41e226047147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:12:57.635537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1308/2578] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:12:57 2022] DELETE /identity/v3/projects/b6cc7be84d074c319f6c2d8628e76f52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:12:57.640856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219ea2d-a70e-449a-91ca-0b3025bb3b25 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:57.641216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219ea2d-a70e-449a-91ca-0b3025bb3b25 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:57.641560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219ea2d-a70e-449a-91ca-0b3025bb3b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:57.661325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c219ea2d-a70e-449a-91ca-0b3025bb3b25 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:57.662593 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c219ea2d-a70e-449a-91ca-0b3025bb3b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:57.733260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1271/2579] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:57.742775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17970-910c-4ad2-81d5-982664395c75 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:57.743099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17970-910c-4ad2-81d5-982664395c75 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:57.743459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17970-910c-4ad2-81d5-982664395c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:57.765117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22d17970-910c-4ad2-81d5-982664395c75 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:57.766370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22d17970-910c-4ad2-81d5-982664395c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:57.776009 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1309/2580] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:57.780474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219ea2d-a70e-449a-91ca-0b3025bb3b25 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:57.796927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219ea2d-a70e-449a-91ca-0b3025bb3b25 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:57.804480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:57.805148 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:57.805431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:57.805703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:57.806475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:12:57.806784 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:57.808453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:57.821326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1272/2581] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:12:57.827625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17970-910c-4ad2-81d5-982664395c75 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:57.839524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17970-910c-4ad2-81d5-982664395c75 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:57.845900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:57.846601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:57.846889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:57.847165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:57.847860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:57.849767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:57.883019 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1310/2582] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:12:57.888692 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:57.899319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2be6-9279-4eef-9b90-ec9b8a417a02 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:57.945739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:57.959641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:57.960311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:57.960597 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:57.960877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:57.961571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:57.963572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:57.984682 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1273/2583] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:12:57 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:12:57.989527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:58.000642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ef010-bbc8-4f42-82e8-9c4ef8114bea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:58.010069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:58.010776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:58.011067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:58.011347 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:58.012078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:58.013697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:58.025671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1311/2584] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:12:58.030254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:58.045012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37db98-7727-4fe4-8234-18143634ca38 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:58.051161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cf779-96b6-4ece-8d04-a54c4d0c90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:58.051825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf779-96b6-4ece-8d04-a54c4d0c90d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:58.052107 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf779-96b6-4ece-8d04-a54c4d0c90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:58.052378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf779-96b6-4ece-8d04-a54c4d0c90d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:58.053106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cf779-96b6-4ece-8d04-a54c4d0c90d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:58.054741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cf779-96b6-4ece-8d04-a54c4d0c90d4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:58.065036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1274/2585] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:12:58.069395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:58.079948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6895e-16bf-4e7e-a2ed-eef54ad49464 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:58.084897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:58.085769 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:58.086046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:58.086354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] PATH_INFO: `/v3/projects/93e3f789241c4802b575734da6682f90/users/ef0cc2f090b240679d5d479d8890f0eb/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:58.101717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e3f789241c4802b575734da6682f90, user_id=ef0cc2f090b240679d5d479d8890f0eb, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:58.104377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:58.116179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:58.122567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1312/2586] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:12:58 2022] PUT /identity/v3/projects/93e3f789241c4802b575734da6682f90/users/ef0cc2f090b240679d5d479d8890f0eb/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:12:58.133845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cdd6-ede8-486d-ae01-0c56e631083c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:58.134078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cdd6-ede8-486d-ae01-0c56e631083c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:58.134382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cdd6-ede8-486d-ae01-0c56e631083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:58.164299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9703cdd6-ede8-486d-ae01-0c56e631083c None None] MFA Rules not processed for user `ef0cc2f090b240679d5d479d8890f0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:12:58.165571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9703cdd6-ede8-486d-ae01-0c56e631083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:58.236023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1275/2587] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:12:58.251709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:12:58.253692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:12:58.333815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa68ee-c116-4df6-876b-59ca02f72acf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:12:58.340178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5454-89b2-40c7-ad71-d98d09b65d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:12:58.340834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5454-89b2-40c7-ad71-d98d09b65d59 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:12:58.341120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5454-89b2-40c7-ad71-d98d09b65d59 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:12:58.341393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5454-89b2-40c7-ad71-d98d09b65d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:12:58.350249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5454-89b2-40c7-ad71-d98d09b65d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:12:58.351841 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5454-89b2-40c7-ad71-d98d09b65d59 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:12:58.361420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1313/2588] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:13:07.856215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703cdd6-ede8-486d-ae01-0c56e631083c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:07.921864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703cdd6-ede8-486d-ae01-0c56e631083c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:07.927680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:07.928563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:07.928818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:07.929115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] PATH_INFO: `/v3/users/ef0cc2f090b240679d5d479d8890f0eb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:07.930382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0cc2f090b240679d5d479d8890f0eb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:07.932338 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:07.984379 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0cc2f090b240679d5d479d8890f0eb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:07.992291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0cc2f090b240679d5d479d8890f0eb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:07.994937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:08.002583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0cc2f090b240679d5d479d8890f0eb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.015277 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0cc2f090b240679d5d479d8890f0eb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.015907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0cc2f090b240679d5d479d8890f0eb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.021788 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1276/2589] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:13:07 2022] DELETE /identity/v3/users/ef0cc2f090b240679d5d479d8890f0eb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:08.026505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.027006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.027105 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.045362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:08.046601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:08.114733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1314/2590] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:08.124944 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:08.126832 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:08.186709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb864-0b53-4443-855e-9d5ea7cf6c74 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:08.191276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc10c-f528-4799-ac42-6be39a222953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:08.191947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc10c-f528-4799-ac42-6be39a222953 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.192225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc10c-f528-4799-ac42-6be39a222953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.192520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc10c-f528-4799-ac42-6be39a222953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.202361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc10c-f528-4799-ac42-6be39a222953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:08.203814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc10c-f528-4799-ac42-6be39a222953 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:08.213533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1277/2591] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:08.497146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:08.498810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:08.511661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc411c2-92d2-4ec0-8e2a-d58cee28f7c9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:08.517669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:08.518615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.518969 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.519161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] PATH_INFO: `/v3/projects/93e3f789241c4802b575734da6682f90` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.520452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e3f789241c4802b575734da6682f90)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:08.522595 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:08.578390 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e3f789241c4802b575734da6682f90', 'request_id': 'req-5cd00bae-de5a-45a5-a5b2-36efb6656803'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.585840 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e3f789241c4802b575734da6682f90', 'request_id': 'req-5cd00bae-de5a-45a5-a5b2-36efb6656803'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.595932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e3f789241c4802b575734da6682f90', 'request_id': 'req-5cd00bae-de5a-45a5-a5b2-36efb6656803'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.607008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] The token cache is being invalidate because project 93e3f789241c4802b575734da6682f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:13:08.607374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.608146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5cd00bae-de5a-45a5-a5b2-36efb6656803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:08.609720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1315/2592] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:13:08 2022] DELETE /identity/v3/projects/93e3f789241c4802b575734da6682f90 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:08.615115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5d8c6-7707-48f4-8e68-ddbaeca4f02c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.615535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5d8c6-7707-48f4-8e68-ddbaeca4f02c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.615818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5d8c6-7707-48f4-8e68-ddbaeca4f02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.633856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-04d5d8c6-7707-48f4-8e68-ddbaeca4f02c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:08.635116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-04d5d8c6-7707-48f4-8e68-ddbaeca4f02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:08.698066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1278/2593] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:08.707820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0b47-9004-4d9c-8d9a-b08c3b708ba9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.708381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0b47-9004-4d9c-8d9a-b08c3b708ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.708679 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0b47-9004-4d9c-8d9a-b08c3b708ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.726255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:08.731852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ec0b0b47-9004-4d9c-8d9a-b08c3b708ba9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:08.734282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ec0b0b47-9004-4d9c-8d9a-b08c3b708ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:08.743915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1316/2594] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:08.750512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5d8c6-7707-48f4-8e68-ddbaeca4f02c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:08.760760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5d8c6-7707-48f4-8e68-ddbaeca4f02c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:08.766328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:08.767186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.767367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.767625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.768354 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:13:08.768643 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:08.770287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:08.782284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1279/2595] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:13:08.788041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b0b47-9004-4d9c-8d9a-b08c3b708ba9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:08.802407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b0b47-9004-4d9c-8d9a-b08c3b708ba9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:08.811701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:08.812833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.813303 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.813776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.814559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:08.816469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:08.848759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1317/2596] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:13:08 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:08.853097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:08.864542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54aad2-b8b6-45d3-8072-a50956a847ac admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:08.923847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:08.924530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.924814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.925088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.925783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:08.927748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:08.938248 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:08.953382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1280/2597] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:13:08 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:08.958349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:08.969361 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61487d81-078b-406d-b953-35eb4cf22139 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:08.974462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:08.975150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:08.975433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:08.975705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:08.976455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:08.978146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:08.989432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1318/2598] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:08.993472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.003925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b486a0-599d-4fda-940d-9e5a8ee0096a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.008695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964540cd-46ee-46f3-857b-210af8a60195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.009352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964540cd-46ee-46f3-857b-210af8a60195 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.009635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964540cd-46ee-46f3-857b-210af8a60195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.009911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964540cd-46ee-46f3-857b-210af8a60195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.010678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964540cd-46ee-46f3-857b-210af8a60195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.012275 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964540cd-46ee-46f3-857b-210af8a60195 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.022698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1281/2599] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:09.026974 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.037673 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2c447-579c-4088-a67d-4f096e85a8c9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.043027 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.043916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.044227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.044507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] PATH_INFO: `/v3/projects/b5b81acb791c48ffae694c799682b5f4/users/4339eee232214f7ea4e66f88bddb80ff/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.060008 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b81acb791c48ffae694c799682b5f4, user_id=4339eee232214f7ea4e66f88bddb80ff, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.062710 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.078616 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1319/2600] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:09 2022] PUT /identity/v3/projects/b5b81acb791c48ffae694c799682b5f4/users/4339eee232214f7ea4e66f88bddb80ff/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:09.089053 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca05e-34a3-4e52-ae78-a3b8aee112aa None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.089343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca05e-34a3-4e52-ae78-a3b8aee112aa None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.089642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca05e-34a3-4e52-ae78-a3b8aee112aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.118499 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-542ca05e-34a3-4e52-ae78-a3b8aee112aa None None] MFA Rules not processed for user `4339eee232214f7ea4e66f88bddb80ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:09.120206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-542ca05e-34a3-4e52-ae78-a3b8aee112aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:09.196537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1282/2601] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:09.201163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.261709 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588217d9-e35c-4d2c-9b30-0edfcdc46bbe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.266601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.267311 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.267594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.267878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.268564 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.270521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.302223 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1320/2602] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:09.306462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ca05e-34a3-4e52-ae78-a3b8aee112aa None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.317929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ca05e-34a3-4e52-ae78-a3b8aee112aa None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.376911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.377524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.377812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.378088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.378803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.380726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.405039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1283/2603] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:13:09 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:09.406272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.417963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3c01e-47db-416d-8a47-5cca3fd81619 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.423531 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.424569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.424854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.425133 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.425862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.427503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.438298 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1321/2604] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:13:09.442722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.453326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369018c-7220-43e6-a032-e5137c99bb7f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.459648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.460571 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.460857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.461136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] PATH_INFO: `/v3/projects/05da6aaf5b0b4c559ee0be6893adf86e/users/cf522b6c99d446fc81c503fb76b4393a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.477345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05da6aaf5b0b4c559ee0be6893adf86e, user_id=cf522b6c99d446fc81c503fb76b4393a, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.480166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.496271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1284/2605] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:09 2022] PUT /identity/v3/projects/05da6aaf5b0b4c559ee0be6893adf86e/users/cf522b6c99d446fc81c503fb76b4393a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:09.500430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.511576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098209ee-6ad0-4c97-95e6-bf45734ee189 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.570410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efea27-e664-4edd-a03a-551f0e0be770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.571095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efea27-e664-4edd-a03a-551f0e0be770 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.571376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efea27-e664-4edd-a03a-551f0e0be770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.571651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efea27-e664-4edd-a03a-551f0e0be770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.572372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efea27-e664-4edd-a03a-551f0e0be770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.574280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efea27-e664-4edd-a03a-551f0e0be770 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.585546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1322/2606] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:09.589774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.600960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897b6c-0188-4be4-878a-de6bf5b1024c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.605811 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.606739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.607020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.607292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] PATH_INFO: `/v3/projects/05da6aaf5b0b4c559ee0be6893adf86e/users/cf522b6c99d446fc81c503fb76b4393a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.609257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=05da6aaf5b0b4c559ee0be6893adf86e, user_id=cf522b6c99d446fc81c503fb76b4393a, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.612078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.623993 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1285/2607] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:09 2022] PUT /identity/v3/projects/05da6aaf5b0b4c559ee0be6893adf86e/users/cf522b6c99d446fc81c503fb76b4393a/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:09.635889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264010-21c0-472d-be7f-64eaea898120 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.636057 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264010-21c0-472d-be7f-64eaea898120 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.636365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264010-21c0-472d-be7f-64eaea898120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.661587 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:09.664989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea264010-21c0-472d-be7f-64eaea898120 None None] MFA Rules not processed for user `cf522b6c99d446fc81c503fb76b4393a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:09.667282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea264010-21c0-472d-be7f-64eaea898120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:09.737162 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1323/2608] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:09.749217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.751991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:09.787108 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:09.817560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5579-2ed0-4465-9705-556d58cf66ca admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.821504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.822299 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.822684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.823059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.833233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.834914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:09.845714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1286/2609] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:09.924819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264010-21c0-472d-be7f-64eaea898120 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:09.934740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264010-21c0-472d-be7f-64eaea898120 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:09.938463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5b3e5-9972-486f-9d37-96fe7d2e133c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:09.939377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b3e5-9972-486f-9d37-96fe7d2e133c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:09.939714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b3e5-9972-486f-9d37-96fe7d2e133c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:09.939992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b3e5-9972-486f-9d37-96fe7d2e133c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:09.997809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5b3e5-9972-486f-9d37-96fe7d2e133c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:09.999302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5b3e5-9972-486f-9d37-96fe7d2e133c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:10.008450 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1324/2610] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:19.841611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=14 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:20.004658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=56 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:52.944963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:53.013412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e65b2-c03d-494e-8712-b4c448d935bc service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:53.019407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:53.020292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.020574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.020846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] PATH_INFO: `/v3/users/4339eee232214f7ea4e66f88bddb80ff` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.022141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4339eee232214f7ea4e66f88bddb80ff)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:53.024094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:53.075231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4339eee232214f7ea4e66f88bddb80ff'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.082659 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4339eee232214f7ea4e66f88bddb80ff'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.091726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4339eee232214f7ea4e66f88bddb80ff'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.104596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4339eee232214f7ea4e66f88bddb80ff'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.105239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4339eee232214f7ea4e66f88bddb80ff'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.111348 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1287/2611] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:13:52 2022] DELETE /identity/v3/users/4339eee232214f7ea4e66f88bddb80ff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:53.116384 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.116966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.116966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.135265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:53.136416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:53.207771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1325/2612] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:53.217881 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:53.219764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:53.283490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed864203-1394-400c-b982-631d31a61ed3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:53.287948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:53.288605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.288889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.289165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.299474 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:53.300925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:53.310914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1288/2613] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:53.599382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:53.600993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:53.614462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963ec5-43d7-4f28-8da8-544bff235805 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:53.620063 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:53.620930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.621330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.621600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] PATH_INFO: `/v3/projects/b5b81acb791c48ffae694c799682b5f4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.623037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b81acb791c48ffae694c799682b5f4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:53.624854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:53.676695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b81acb791c48ffae694c799682b5f4', 'request_id': 'req-aa86f654-a93d-4d4b-859a-77dd8fffaf16'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.683012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b81acb791c48ffae694c799682b5f4', 'request_id': 'req-aa86f654-a93d-4d4b-859a-77dd8fffaf16'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.692903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b81acb791c48ffae694c799682b5f4', 'request_id': 'req-aa86f654-a93d-4d4b-859a-77dd8fffaf16'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.703948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] The token cache is being invalidate because project b5b81acb791c48ffae694c799682b5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:13:53.704237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.704887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.706569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1326/2614] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:13:53 2022] DELETE /identity/v3/projects/b5b81acb791c48ffae694c799682b5f4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:53.711355 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:53.723961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7ccb-0bcb-40cc-b9f3-413b89cbfb1d service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:53.743902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:53.786640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:53.787548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.787821 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.788095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] PATH_INFO: `/v3/users/cf522b6c99d446fc81c503fb76b4393a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.789304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf522b6c99d446fc81c503fb76b4393a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:53.791297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:53.845915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf522b6c99d446fc81c503fb76b4393a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.852824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf522b6c99d446fc81c503fb76b4393a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.865386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf522b6c99d446fc81c503fb76b4393a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.881307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf522b6c99d446fc81c503fb76b4393a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.882014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ebfdb800-d12f-47e7-9139-17c29a178d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf522b6c99d446fc81c503fb76b4393a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:53.888995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1289/2615] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:13:53 2022] DELETE /identity/v3/users/cf522b6c99d446fc81c503fb76b4393a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:54.172341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.174050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:54.189371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f654-a93d-4d4b-859a-77dd8fffaf16 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:54.249328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:54.250350 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.250796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.251080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] PATH_INFO: `/v3/projects/05da6aaf5b0b4c559ee0be6893adf86e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.252302 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05da6aaf5b0b4c559ee0be6893adf86e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:54.254269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:54.287348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:54.306326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05da6aaf5b0b4c559ee0be6893adf86e', 'request_id': 'req-11d3752e-77e1-4623-bc48-e409f5f5c674'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:54.312357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05da6aaf5b0b4c559ee0be6893adf86e', 'request_id': 'req-11d3752e-77e1-4623-bc48-e409f5f5c674'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:54.321524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05da6aaf5b0b4c559ee0be6893adf86e', 'request_id': 'req-11d3752e-77e1-4623-bc48-e409f5f5c674'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:54.332330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] The token cache is being invalidate because project 05da6aaf5b0b4c559ee0be6893adf86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:13:54.332613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:54.333275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11d3752e-77e1-4623-bc48-e409f5f5c674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:54.334880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1327/2616] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:13:54 2022] DELETE /identity/v3/projects/05da6aaf5b0b4c559ee0be6893adf86e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:54.339906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b032f6-4684-411c-bd53-91fe608fd8fa None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.340398 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b032f6-4684-411c-bd53-91fe608fd8fa None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.340512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b032f6-4684-411c-bd53-91fe608fd8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.359325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-20b032f6-4684-411c-bd53-91fe608fd8fa None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:54.360620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-20b032f6-4684-411c-bd53-91fe608fd8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:54.424900 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1290/2617] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:54.433034 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c6ccb-6c44-44d6-8b98-0c5e4c1430f5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.433315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c6ccb-6c44-44d6-8b98-0c5e4c1430f5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.433596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c6ccb-6c44-44d6-8b98-0c5e4c1430f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.453136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-117c6ccb-6c44-44d6-8b98-0c5e4c1430f5 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:54.454917 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-117c6ccb-6c44-44d6-8b98-0c5e4c1430f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:54.464905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1328/2618] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:54.469757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b032f6-4684-411c-bd53-91fe608fd8fa None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.479441 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b032f6-4684-411c-bd53-91fe608fd8fa None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:54.484155 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:54.484995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.485376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.485677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.486442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:13:54.486750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:54.488715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:54.501674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1291/2619] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:13:54.506153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c6ccb-6c44-44d6-8b98-0c5e4c1430f5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.516044 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c6ccb-6c44-44d6-8b98-0c5e4c1430f5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:54.522633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:54.523291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.523574 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.523848 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.524516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:54.526487 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:54.560087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1329/2620] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:13:54 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:54.564985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.575353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d40e0-8a07-4716-a760-426b44cf4e50 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:54.601596 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:54.637432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:54.638126 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.638434 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.638715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.639427 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:54.641475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:54.664395 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1292/2621] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:13:54 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:54.669091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.680500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafb31-2f48-497e-a921-91a2f0aee993 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:54.685903 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:54.686610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.686897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.687196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.688003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:54.689601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:54.700150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1330/2622] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:54.704206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.714520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e483e-0857-4317-a8ff-bc5f8f0d6464 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:54.719778 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb44ba-f8e0-4ffb-83d0-cb2a14dfbc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:54.720447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb44ba-f8e0-4ffb-83d0-cb2a14dfbc07 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.720764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb44ba-f8e0-4ffb-83d0-cb2a14dfbc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.721055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb44ba-f8e0-4ffb-83d0-cb2a14dfbc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.721812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb44ba-f8e0-4ffb-83d0-cb2a14dfbc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:54.723463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb44ba-f8e0-4ffb-83d0-cb2a14dfbc07 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:54.733967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1293/2623] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:54.738508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.749050 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74124-8228-40b8-8212-0c44d0a41249 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:54.754288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:54.755129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.755416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.755696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] PATH_INFO: `/v3/projects/ef0da58783594d6c9ebf81abe1d71800/users/7e8096036545436ebc36266c458a4ebe/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.771323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0da58783594d6c9ebf81abe1d71800, user_id=7e8096036545436ebc36266c458a4ebe, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:54.773987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:54.794260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1331/2624] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:54 2022] PUT /identity/v3/projects/ef0da58783594d6c9ebf81abe1d71800/users/7e8096036545436ebc36266c458a4ebe/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:54.806556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0499ae1-f067-41d5-95b9-aa8398c486af None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:54.806917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0499ae1-f067-41d5-95b9-aa8398c486af None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:54.807266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0499ae1-f067-41d5-95b9-aa8398c486af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:54.841283 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c0499ae1-f067-41d5-95b9-aa8398c486af None None] MFA Rules not processed for user `7e8096036545436ebc36266c458a4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:54.842999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c0499ae1-f067-41d5-95b9-aa8398c486af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:54.920468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1294/2625] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:54.925765 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:54.995908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50648ffb-f11f-44a7-86a0-306a5fc21e1e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.004412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.005272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.005572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.006297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.007407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.011261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.042638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1332/2626] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:13:54 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:55.046887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0499ae1-f067-41d5-95b9-aa8398c486af None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.058297 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0499ae1-f067-41d5-95b9-aa8398c486af None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.123033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.123708 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.124014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.124272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.124965 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.127090 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.149604 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1295/2627] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:13:55 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:55.153643 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.164398 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84182a-96f7-4e56-b7e3-9a2dca1aad57 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.169500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.170223 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.170510 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.170783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.171505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.173497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.184168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1333/2628] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:55.188927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.199011 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaaa25-3b44-4251-8918-8fef559ae982 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.204456 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.205694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.206088 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.206542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] PATH_INFO: `/v3/projects/bfdd0298cdd046e5aac025bcfb351e6d/users/4c420f7030f141b2b68015af615afa23/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.226871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdd0298cdd046e5aac025bcfb351e6d, user_id=4c420f7030f141b2b68015af615afa23, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.229685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.245707 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1296/2629] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:55 2022] PUT /identity/v3/projects/bfdd0298cdd046e5aac025bcfb351e6d/users/4c420f7030f141b2b68015af615afa23/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:55.249892 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.260998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc440-15d3-40b1-bb1c-187ae6d9b21b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.282120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:55.321644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4b581-d6a8-4877-b105-f98289f0c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.322389 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4b581-d6a8-4877-b105-f98289f0c007 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.322678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4b581-d6a8-4877-b105-f98289f0c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.322954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4b581-d6a8-4877-b105-f98289f0c007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.323675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4b581-d6a8-4877-b105-f98289f0c007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.325288 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4b581-d6a8-4877-b105-f98289f0c007 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.335559 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1334/2630] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:55.339947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.345642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:55.351294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88826ce-1d26-45e2-94ef-83fc1653b1cd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.356757 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.357685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.357964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.358278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] PATH_INFO: `/v3/projects/bfdd0298cdd046e5aac025bcfb351e6d/users/4c420f7030f141b2b68015af615afa23/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.360304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdd0298cdd046e5aac025bcfb351e6d, user_id=4c420f7030f141b2b68015af615afa23, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.363310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.373639 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1297/2631] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:55 2022] PUT /identity/v3/projects/bfdd0298cdd046e5aac025bcfb351e6d/users/4c420f7030f141b2b68015af615afa23/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:55.384148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e026-9738-46e2-9666-25c175775701 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.384443 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e026-9738-46e2-9666-25c175775701 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.384731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e026-9738-46e2-9666-25c175775701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.412521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a7f4e026-9738-46e2-9666-25c175775701 None None] MFA Rules not processed for user `4c420f7030f141b2b68015af615afa23`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:55.413758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a7f4e026-9738-46e2-9666-25c175775701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:55.490093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1335/2632] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:55.504124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.506224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:55.569545 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea1d89-5235-4953-869a-6693340eec88 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.574054 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a9f05-42c9-4c54-8af4-3266137d35ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.574747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a9f05-42c9-4c54-8af4-3266137d35ee service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.575035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a9f05-42c9-4c54-8af4-3266137d35ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.575315 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a9f05-42c9-4c54-8af4-3266137d35ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.585644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a9f05-42c9-4c54-8af4-3266137d35ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.587131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a9f05-42c9-4c54-8af4-3266137d35ee service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.597384 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1298/2633] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:55.631429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e026-9738-46e2-9666-25c175775701 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.696380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e026-9738-46e2-9666-25c175775701 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.702705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.703665 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.704210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.704776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] PATH_INFO: `/v3/users/7e8096036545436ebc36266c458a4ebe` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.706012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8096036545436ebc36266c458a4ebe)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.708030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.758326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8096036545436ebc36266c458a4ebe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:55.759508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:55.766503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8096036545436ebc36266c458a4ebe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:55.775744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8096036545436ebc36266c458a4ebe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:55.788007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8096036545436ebc36266c458a4ebe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:55.788658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8096036545436ebc36266c458a4ebe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:55.794669 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1336/2634] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:13:55 2022] DELETE /identity/v3/users/7e8096036545436ebc36266c458a4ebe => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:55.799397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.799694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.799982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.817777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:55.819012 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:55.880329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1299/2635] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:55.890270 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:55.892126 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:55.964946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed273dc-7158-4a7e-8a6c-7277e864b8ca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:55.970703 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:55.971345 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:55.971625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:55.971900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:55.981502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:55.982975 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:55.993047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1337/2636] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:56.314269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:56.315800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:56.328080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6345da-dd72-4923-bdd0-e1ddab636abc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:56.333488 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:56.334403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:56.334674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:56.334951 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] PATH_INFO: `/v3/projects/ef0da58783594d6c9ebf81abe1d71800` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:56.336189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0da58783594d6c9ebf81abe1d71800)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:56.338149 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:56.386910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0da58783594d6c9ebf81abe1d71800', 'request_id': 'req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.393144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0da58783594d6c9ebf81abe1d71800', 'request_id': 'req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.403077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0da58783594d6c9ebf81abe1d71800', 'request_id': 'req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.414318 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] The token cache is being invalidate because project ef0da58783594d6c9ebf81abe1d71800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:13:56.414606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.415249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.416824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1300/2637] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:13:56 2022] DELETE /identity/v3/projects/ef0da58783594d6c9ebf81abe1d71800 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:56.422542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:56.433937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2da38-4d96-44c1-b3db-aac6b2c01ca8 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:56.497724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:56.498670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:56.498952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:56.499226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] PATH_INFO: `/v3/users/4c420f7030f141b2b68015af615afa23` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:56.500606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c420f7030f141b2b68015af615afa23)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:56.502871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:56.564005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c420f7030f141b2b68015af615afa23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.574081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c420f7030f141b2b68015af615afa23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.585806 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c420f7030f141b2b68015af615afa23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.593507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:56.604052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c420f7030f141b2b68015af615afa23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.605201 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1d3d854-a388-4623-b76c-30d322aab370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c420f7030f141b2b68015af615afa23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:56.614269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1338/2638] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:13:56 2022] DELETE /identity/v3/users/4c420f7030f141b2b68015af615afa23 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:56.902247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:56.903720 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:56.917875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014cf0c-b303-47b3-9c1b-a8f5288e0cb3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:56.931425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:56.978520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:56.979397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:56.979676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:56.980067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] PATH_INFO: `/v3/projects/bfdd0298cdd046e5aac025bcfb351e6d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:56.981457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdd0298cdd046e5aac025bcfb351e6d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:56.983411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.035406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdd0298cdd046e5aac025bcfb351e6d', 'request_id': 'req-e61de79c-4eda-4f85-a679-1c60c039c624'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:57.041844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdd0298cdd046e5aac025bcfb351e6d', 'request_id': 'req-e61de79c-4eda-4f85-a679-1c60c039c624'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:57.051306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdd0298cdd046e5aac025bcfb351e6d', 'request_id': 'req-e61de79c-4eda-4f85-a679-1c60c039c624'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:57.062799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] The token cache is being invalidate because project bfdd0298cdd046e5aac025bcfb351e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:13:57.063281 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:57.064154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e61de79c-4eda-4f85-a679-1c60c039c624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:13:57.065820 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1301/2639] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:13:56 2022] DELETE /identity/v3/projects/bfdd0298cdd046e5aac025bcfb351e6d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:57.071084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab64d0-c33f-4ced-a7ff-df8e2c06add9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.071394 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab64d0-c33f-4ced-a7ff-df8e2c06add9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.071676 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab64d0-c33f-4ced-a7ff-df8e2c06add9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.091706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-74ab64d0-c33f-4ced-a7ff-df8e2c06add9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:57.092928 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-74ab64d0-c33f-4ced-a7ff-df8e2c06add9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:57.156026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1339/2640] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:57.165455 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e4609-eeb2-40a0-808f-0bd5c898aadd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.165785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e4609-eeb2-40a0-808f-0bd5c898aadd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.166068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e4609-eeb2-40a0-808f-0bd5c898aadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.185740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f70e4609-eeb2-40a0-808f-0bd5c898aadd None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:57.187006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f70e4609-eeb2-40a0-808f-0bd5c898aadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:57.196013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1302/2641] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:57.200434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab64d0-c33f-4ced-a7ff-df8e2c06add9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.210862 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab64d0-c33f-4ced-a7ff-df8e2c06add9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.216519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.217174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.217448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.217719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.218480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:13:57.218785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.220395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.232611 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1340/2642] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:13:57.237036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e4609-eeb2-40a0-808f-0bd5c898aadd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.246670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e4609-eeb2-40a0-808f-0bd5c898aadd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.251763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.252417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.252704 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.252982 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.253675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.255627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.287425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1303/2643] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:13:57 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:57.291601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.302080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353125-1319-48c3-8bbe-5b51fcdde5cf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.359444 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.360164 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.360453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.360732 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.361430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.363749 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.384757 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1341/2644] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:13:57 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:13:57.388997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.400494 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231898bf-302f-402c-9530-ffd990698c75 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.405818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.406588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.406967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.407579 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.408314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.409924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.421185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1304/2645] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:57.426657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.440951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823631-0f60-4cca-a0c4-1720722bc65b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.446612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e612e6f-823b-4ebd-9657-109e8fa74ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.447278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612e6f-823b-4ebd-9657-109e8fa74ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.447561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612e6f-823b-4ebd-9657-109e8fa74ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.447837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612e6f-823b-4ebd-9657-109e8fa74ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.448570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e612e6f-823b-4ebd-9657-109e8fa74ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.450282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e612e6f-823b-4ebd-9657-109e8fa74ec7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.460863 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1342/2646] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:13:57.465097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.476382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5677-9102-4efe-ad39-496a84104240 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.482285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.483183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.483468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.483743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] PATH_INFO: `/v3/projects/d0d0979ff9214ec49aefceab3efdb70e/users/daf49b80f1fb45c9b7fb0a6168757247/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.502131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d0979ff9214ec49aefceab3efdb70e, user_id=daf49b80f1fb45c9b7fb0a6168757247, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.504961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.520585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1305/2647] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:57 2022] PUT /identity/v3/projects/d0d0979ff9214ec49aefceab3efdb70e/users/daf49b80f1fb45c9b7fb0a6168757247/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:57.531071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77fa17-2926-42bc-a3af-e3840a7c13ad None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.531360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77fa17-2926-42bc-a3af-e3840a7c13ad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.531647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77fa17-2926-42bc-a3af-e3840a7c13ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.559250 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-de77fa17-2926-42bc-a3af-e3840a7c13ad None None] MFA Rules not processed for user `daf49b80f1fb45c9b7fb0a6168757247`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:57.560481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de77fa17-2926-42bc-a3af-e3840a7c13ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:57.601518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:57.635745 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1343/2648] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:57.643005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.693627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:57.720960 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903de1a-5d76-4db8-bd1e-946dabeef2e9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.726724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109662-0587-4ad1-8939-51787683daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.727389 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109662-0587-4ad1-8939-51787683daed admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.727670 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109662-0587-4ad1-8939-51787683daed admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.727939 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109662-0587-4ad1-8939-51787683daed admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.728654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109662-0587-4ad1-8939-51787683daed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.730626 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109662-0587-4ad1-8939-51787683daed admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.759210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1306/2649] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:13:57 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:57.763586 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77fa17-2926-42bc-a3af-e3840a7c13ad None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.775188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77fa17-2926-42bc-a3af-e3840a7c13ad None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.834833 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.835494 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.835801 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.836069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.836729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.838680 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.861120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1344/2650] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:13:57 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:57.865934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109662-0587-4ad1-8939-51787683daed admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.877120 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109662-0587-4ad1-8939-51787683daed admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.884711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.885721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.886086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.886493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.887566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.889989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.901652 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1307/2651] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:57.905700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.916428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996df1-d274-405a-9b79-fb30f2c38da1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.922773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e8f74-88b4-4fc7-b7d9-03bef05567cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.923793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8f74-88b4-4fc7-b7d9-03bef05567cd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.924087 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8f74-88b4-4fc7-b7d9-03bef05567cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.924386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8f74-88b4-4fc7-b7d9-03bef05567cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.925267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e8f74-88b4-4fc7-b7d9-03bef05567cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.927118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e8f74-88b4-4fc7-b7d9-03bef05567cd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.939677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1345/2652] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:57.942947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:57.953259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05452eaa-2387-4e70-823d-8ff1f774528d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:57.958343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:57.959243 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:57.959531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:57.959810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] PATH_INFO: `/v3/projects/c89b25dca56c42deaf8daedd9fd9d699/users/3c4ce358a7fe428dbf05099caa5e4caa/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:57.976848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89b25dca56c42deaf8daedd9fd9d699, user_id=3c4ce358a7fe428dbf05099caa5e4caa, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:57.979613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:57.997136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1308/2653] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:57 2022] PUT /identity/v3/projects/c89b25dca56c42deaf8daedd9fd9d699/users/3c4ce358a7fe428dbf05099caa5e4caa/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:58.008292 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363af4dc-3578-48ff-97eb-d06597157f64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.008580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363af4dc-3578-48ff-97eb-d06597157f64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.009130 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363af4dc-3578-48ff-97eb-d06597157f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.037690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-363af4dc-3578-48ff-97eb-d06597157f64 None None] MFA Rules not processed for user `3c4ce358a7fe428dbf05099caa5e4caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:58.038966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-363af4dc-3578-48ff-97eb-d06597157f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:58.112534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1346/2654] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:58.118021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:58.183555 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339070-bc35-4633-ab0b-a79ff518643b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:58.188805 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:58.189475 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.189766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.190049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.190773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:58.192696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:58.220385 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1309/2655] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:13:58 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:58.224734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363af4dc-3578-48ff-97eb-d06597157f64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:58.236017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363af4dc-3578-48ff-97eb-d06597157f64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:58.286838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:58.299068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:58.299741 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.300026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.300301 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.301005 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:58.302971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:58.325129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1347/2656] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:13:58 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:13:58.329433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:58.340131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641e864-e4be-4953-9d6c-30f6612fb66e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:58.345728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:58.346432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.346723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.347005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.347738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:58.349373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:58.360991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1310/2657] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:58.366307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:58.379295 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673a57-bf9b-4f54-be0e-ec820fb07d88 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:58.385065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:58.385957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.386266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.386539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] PATH_INFO: `/v3/projects/96433b5b37dc48609d5a956b34be6599/users/d8a42b2e7df64a488b05193452ee2fa8/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.404694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96433b5b37dc48609d5a956b34be6599, user_id=d8a42b2e7df64a488b05193452ee2fa8, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:58.408524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:58.426533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1348/2658] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:58 2022] PUT /identity/v3/projects/96433b5b37dc48609d5a956b34be6599/users/d8a42b2e7df64a488b05193452ee2fa8/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:58.432461 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:58.445271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2743e-8e6e-4f89-be0e-03255bdda708 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:58.512611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf4892-fe8d-4906-b2e0-d2bd1fc36c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:58.513492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4892-fe8d-4906-b2e0-d2bd1fc36c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.513874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4892-fe8d-4906-b2e0-d2bd1fc36c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.514178 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4892-fe8d-4906-b2e0-d2bd1fc36c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.515309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf4892-fe8d-4906-b2e0-d2bd1fc36c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:58.517844 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf4892-fe8d-4906-b2e0-d2bd1fc36c26 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:58.532912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1311/2659] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:13:58.537481 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:58.548989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4eccf-5c48-410f-85bd-1fc8e363830c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:58.554084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:58.555011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.555297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.555582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] PATH_INFO: `/v3/projects/96433b5b37dc48609d5a956b34be6599/users/d8a42b2e7df64a488b05193452ee2fa8/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.557651 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96433b5b37dc48609d5a956b34be6599, user_id=d8a42b2e7df64a488b05193452ee2fa8, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:58.560330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:58.571387 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1349/2660] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:13:58 2022] PUT /identity/v3/projects/96433b5b37dc48609d5a956b34be6599/users/d8a42b2e7df64a488b05193452ee2fa8/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:13:58.583276 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.583569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.583850 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.590642 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:58.616497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] MFA Rules not processed for user `d8a42b2e7df64a488b05193452ee2fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:58.617740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:58.693111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1312/2661] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:58.704686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:58.706694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:58.771166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583c4e4-38ae-434a-9552-61f40776847f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:58.777318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:58.778320 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:58.778674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:58.779028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:58.796433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:58.798603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:58.812512 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1350/2662] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:59.332688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:59.334410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:59.348428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c99dd-b93a-4a97-926e-9af7add5ad09 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:59.353034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:59.353678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:59.353973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:59.354288 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:59.415400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:59.416871 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:59.427265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1313/2663] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:03.513743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:03.526422 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb39d-0ac8-471d-8f50-890bcfdbf110 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:03.531601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc492c87-3820-46ba-9901-74093832819a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:03.532476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc492c87-3820-46ba-9901-74093832819a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:03.532766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc492c87-3820-46ba-9901-74093832819a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:03.533469 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc492c87-3820-46ba-9901-74093832819a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:03.592623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc492c87-3820-46ba-9901-74093832819a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:03.594074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc492c87-3820-46ba-9901-74093832819a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:03.603289 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1351/2664] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:05.812895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:05.894321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652a27a-205a-4a5b-be56-fdc71793ec48 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:05.899909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:05.900806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:05.901091 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:05.901367 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] PATH_INFO: `/v3/users/daf49b80f1fb45c9b7fb0a6168757247` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:05.902676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf49b80f1fb45c9b7fb0a6168757247)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:05.904632 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:05.942727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:05.972800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf49b80f1fb45c9b7fb0a6168757247'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:05.984158 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf49b80f1fb45c9b7fb0a6168757247'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.002761 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf49b80f1fb45c9b7fb0a6168757247'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.016576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf49b80f1fb45c9b7fb0a6168757247'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.017372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf49b80f1fb45c9b7fb0a6168757247'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.025764 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1314/2665] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:05 2022] DELETE /identity/v3/users/daf49b80f1fb45c9b7fb0a6168757247 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:06.030588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:06.031132 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:06.031264 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:06.052416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:06.053649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:06.098293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:06.118783 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1352/2666] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:06.128687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:06.130356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:06.190819 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039869-e3d0-4a7a-804d-f3622314a018 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:06.195192 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:06.195848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:06.196137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:06.196411 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:06.206550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:06.208003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:06.218480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1315/2667] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:06.498982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:06.500550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:06.521719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f0455-8e4a-44a3-947a-34c464f2855c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:06.526593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:06.527585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:06.527980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:06.528360 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] PATH_INFO: `/v3/projects/d0d0979ff9214ec49aefceab3efdb70e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:06.530371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d0979ff9214ec49aefceab3efdb70e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:06.532937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:06.583385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d0979ff9214ec49aefceab3efdb70e', 'request_id': 'req-ba347aac-5525-4c8c-8693-0a26e7281d23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.590376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d0979ff9214ec49aefceab3efdb70e', 'request_id': 'req-ba347aac-5525-4c8c-8693-0a26e7281d23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.599820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d0979ff9214ec49aefceab3efdb70e', 'request_id': 'req-ba347aac-5525-4c8c-8693-0a26e7281d23'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.610653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] The token cache is being invalidate because project d0d0979ff9214ec49aefceab3efdb70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:06.611038 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.611733 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.613779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1353/2668] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:06 2022] DELETE /identity/v3/projects/d0d0979ff9214ec49aefceab3efdb70e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:06.617810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:06.627766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e11819-3cf7-4040-9142-55a644fc8509 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:06.687369 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:06.688284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:06.688566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:06.688840 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] PATH_INFO: `/v3/users/3c4ce358a7fe428dbf05099caa5e4caa` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:06.690038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4ce358a7fe428dbf05099caa5e4caa)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:06.692631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:06.743294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4ce358a7fe428dbf05099caa5e4caa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.745257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:06.751390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4ce358a7fe428dbf05099caa5e4caa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.762665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4ce358a7fe428dbf05099caa5e4caa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.774829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4ce358a7fe428dbf05099caa5e4caa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.775454 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4ce358a7fe428dbf05099caa5e4caa'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:06.781638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1316/2669] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:06 2022] DELETE /identity/v3/users/3c4ce358a7fe428dbf05099caa5e4caa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:07.069152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:07.070729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:07.085267 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347aac-5525-4c8c-8693-0a26e7281d23 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:07.145600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:07.146509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:07.146767 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:07.147046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] PATH_INFO: `/v3/projects/c89b25dca56c42deaf8daedd9fd9d699` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:07.148246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89b25dca56c42deaf8daedd9fd9d699)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:07.150218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:07.199730 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89b25dca56c42deaf8daedd9fd9d699', 'request_id': 'req-eda184db-7b7d-41e6-ae08-9e9c307e95c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.205910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89b25dca56c42deaf8daedd9fd9d699', 'request_id': 'req-eda184db-7b7d-41e6-ae08-9e9c307e95c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.216719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89b25dca56c42deaf8daedd9fd9d699', 'request_id': 'req-eda184db-7b7d-41e6-ae08-9e9c307e95c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.223577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:07.228921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] The token cache is being invalidate because project c89b25dca56c42deaf8daedd9fd9d699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:07.229315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.230088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.232150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1354/2670] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:07 2022] DELETE /identity/v3/projects/c89b25dca56c42deaf8daedd9fd9d699 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:07.236834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:07.239087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:07.251648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8de7f0-5b97-4d08-8989-891bee730c3c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:07.310802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:07.311686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:07.311995 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:07.312270 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] PATH_INFO: `/v3/users/d8a42b2e7df64a488b05193452ee2fa8` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:07.313591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a42b2e7df64a488b05193452ee2fa8)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:07.315585 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:07.368229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a42b2e7df64a488b05193452ee2fa8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.375196 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a42b2e7df64a488b05193452ee2fa8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.384188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a42b2e7df64a488b05193452ee2fa8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.397295 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a42b2e7df64a488b05193452ee2fa8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.398215 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a42b2e7df64a488b05193452ee2fa8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.404470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1317/2671] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:07 2022] DELETE /identity/v3/users/d8a42b2e7df64a488b05193452ee2fa8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:07.686263 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:07.687842 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:07.701318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda184db-7b7d-41e6-ae08-9e9c307e95c7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:07.773107 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:07.774074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:07.774497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:07.774881 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] PATH_INFO: `/v3/projects/96433b5b37dc48609d5a956b34be6599` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:07.776409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96433b5b37dc48609d5a956b34be6599)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:07.781111 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:07.845539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96433b5b37dc48609d5a956b34be6599', 'request_id': 'req-e10b7143-95b3-43aa-9afd-236ea25afd01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.852640 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96433b5b37dc48609d5a956b34be6599', 'request_id': 'req-e10b7143-95b3-43aa-9afd-236ea25afd01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.864714 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96433b5b37dc48609d5a956b34be6599', 'request_id': 'req-e10b7143-95b3-43aa-9afd-236ea25afd01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.868015 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:07.869617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:07.888517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] The token cache is being invalidate because project 96433b5b37dc48609d5a956b34be6599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:07.888910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.889588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e10b7143-95b3-43aa-9afd-236ea25afd01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:07.891878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1355/2672] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:07 2022] DELETE /identity/v3/projects/96433b5b37dc48609d5a956b34be6599 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:07.903631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52dec-8ece-4413-9b41-a3f31cce7a32 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:07.904095 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52dec-8ece-4413-9b41-a3f31cce7a32 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:07.904385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52dec-8ece-4413-9b41-a3f31cce7a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:07.932474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-66c52dec-8ece-4413-9b41-a3f31cce7a32 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:07.933878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66c52dec-8ece-4413-9b41-a3f31cce7a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:07.953695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:07.990462 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e88c23-b0b3-4274-90ff-ff632b62ee6b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.050927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1356/2673] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:08.054410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cb51-2324-4f5c-8062-71d24cf7c07c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.054711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cb51-2324-4f5c-8062-71d24cf7c07c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.055125 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cb51-2324-4f5c-8062-71d24cf7c07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.075457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.076133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.076419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.076696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.078611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:08.080053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dcd2cb51-2324-4f5c-8062-71d24cf7c07c None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:08.081266 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dcd2cb51-2324-4f5c-8062-71d24cf7c07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:08.091617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1357/2674] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:08.095290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.096698 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.099528 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2cb51-2324-4f5c-8062-71d24cf7c07c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.109152 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1318/2675] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:08.112117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2cb51-2324-4f5c-8062-71d24cf7c07c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.123017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.123986 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.124430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.125511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.126502 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:14:08.127184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.129203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.145762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1358/2676] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:14:08.147165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.162306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475baed2-e82a-4dcc-98aa-0fbaeee4d23a service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.166885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.167548 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.167880 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.168111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.168795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.170748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.200059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1319/2677] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:14:08 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:08.204377 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.216844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f24a1-4c21-4dc6-a7cd-4829cff7b5f4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.223654 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:08.294380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.295226 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.295519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.295800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.296496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.298511 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.324887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1359/2678] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:14:08 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:08.328831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.340829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9847b-173d-4137-9711-6ffadc594860 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.345622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.346361 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.346809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.346941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.347755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.350142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.361353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1320/2679] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:08.366022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.378760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035c6d-0b1a-4412-9d01-dfcfa6773b39 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.384518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2b402-8e0d-4c8a-888f-df8b04874521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.385341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2b402-8e0d-4c8a-888f-df8b04874521 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.386100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2b402-8e0d-4c8a-888f-df8b04874521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.386475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2b402-8e0d-4c8a-888f-df8b04874521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.387304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2b402-8e0d-4c8a-888f-df8b04874521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.389045 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2b402-8e0d-4c8a-888f-df8b04874521 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.399421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1360/2680] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:08.403946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.414800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5db6a-3982-4fb2-8f31-403b29f17350 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.419833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.420724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.421037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.421392 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] PATH_INFO: `/v3/projects/a9765c22cd884cdda4e81a0a06f1a730/users/52370b538bf74fc095dfb9cf6eb470f1/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.438558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9765c22cd884cdda4e81a0a06f1a730, user_id=52370b538bf74fc095dfb9cf6eb470f1, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.441221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.457978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1321/2681] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:08 2022] PUT /identity/v3/projects/a9765c22cd884cdda4e81a0a06f1a730/users/52370b538bf74fc095dfb9cf6eb470f1/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:08.527636 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae36f-f3cd-4112-a85c-6d37acab9c28 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.527916 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae36f-f3cd-4112-a85c-6d37acab9c28 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.528188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae36f-f3cd-4112-a85c-6d37acab9c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.557902 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-de3ae36f-f3cd-4112-a85c-6d37acab9c28 None None] MFA Rules not processed for user `52370b538bf74fc095dfb9cf6eb470f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:08.559321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de3ae36f-f3cd-4112-a85c-6d37acab9c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:08.630160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1361/2682] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:08.633734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.697180 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54eff1-ae0f-4a3a-9663-839584115292 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.701878 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.702573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.702863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.703168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.703853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.705750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.729527 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:08.738530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1322/2683] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:14:08 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:08.742290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ae36f-f3cd-4112-a85c-6d37acab9c28 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.753735 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ae36f-f3cd-4112-a85c-6d37acab9c28 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.814693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.815382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.815668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.815949 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.816707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.818715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.845475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1362/2684] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:14:08 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:08.849727 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.861605 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc464b6f-697a-485b-b424-a9216a737518 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.869472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.870217 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.870507 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.870789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.871522 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.873566 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.886603 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1323/2685] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:08.891244 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.901495 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea5fb-f330-4536-bf5b-8afdab70eb9b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:08.906098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:08.907002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:08.907280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:08.907554 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] PATH_INFO: `/v3/projects/d2a6b823c5a64b8e9b26dc99eec5a32a/users/11e34e2c08e14dde8ae6f6fc2f5d7d94/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:08.909879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:08.925046 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a6b823c5a64b8e9b26dc99eec5a32a, user_id=11e34e2c08e14dde8ae6f6fc2f5d7d94, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:08.928456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:08.945762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1363/2686] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:08 2022] PUT /identity/v3/projects/d2a6b823c5a64b8e9b26dc99eec5a32a/users/11e34e2c08e14dde8ae6f6fc2f5d7d94/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:08.946985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:08.957866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124a7bc-1ccc-4b43-98a3-e095836a1273 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:09.022481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce666a-74f6-487a-abdf-b53f656f5ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:09.023166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce666a-74f6-487a-abdf-b53f656f5ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:09.023481 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce666a-74f6-487a-abdf-b53f656f5ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:09.023743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce666a-74f6-487a-abdf-b53f656f5ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:09.024470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce666a-74f6-487a-abdf-b53f656f5ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:09.026588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce666a-74f6-487a-abdf-b53f656f5ad6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:09.037034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1324/2687] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:09.041734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:09.053313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf352-f408-4859-a955-211aa437da63 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:09.059772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:09.060661 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:09.060943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:09.061219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] PATH_INFO: `/v3/projects/d2a6b823c5a64b8e9b26dc99eec5a32a/users/11e34e2c08e14dde8ae6f6fc2f5d7d94/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:09.063662 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a6b823c5a64b8e9b26dc99eec5a32a, user_id=11e34e2c08e14dde8ae6f6fc2f5d7d94, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:09.066328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:09.078339 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1364/2688] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:09 2022] PUT /identity/v3/projects/d2a6b823c5a64b8e9b26dc99eec5a32a/users/11e34e2c08e14dde8ae6f6fc2f5d7d94/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:09.089034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:09.089334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:09.089631 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:09.121221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] MFA Rules not processed for user `11e34e2c08e14dde8ae6f6fc2f5d7d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:09.122961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:09.195983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1325/2689] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:09.207568 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:09.209637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:09.268701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91c9d-41b1-4808-9f43-2367f8fcaa97 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:09.273194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ebf3-4642-4961-add7-c3351a9c3fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:09.273839 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ebf3-4642-4961-add7-c3351a9c3fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:09.274142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ebf3-4642-4961-add7-c3351a9c3fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:09.274425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ebf3-4642-4961-add7-c3351a9c3fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:09.285652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5ebf3-4642-4961-add7-c3351a9c3fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:09.287183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5ebf3-4642-4961-add7-c3351a9c3fd4 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:09.297254 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1365/2690] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:09.349258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:09.351476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:09.371839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245b302-a93e-43f2-8edb-eb5f9357fdc2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:09.378230 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:09.379335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:09.379768 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:09.380059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:09.440032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:09.441498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:09.450724 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1326/2691] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:11.874455 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64250-8636-4c7c-85fd-a2ebb4e07e58 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:11.875055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64250-8636-4c7c-85fd-a2ebb4e07e58 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:11.875055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64250-8636-4c7c-85fd-a2ebb4e07e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:11.893245 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-69d64250-8636-4c7c-85fd-a2ebb4e07e58 None None] MFA Rules not processed for user `49b596abb9a5466595eec1a8fb25d5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:11.894533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69d64250-8636-4c7c-85fd-a2ebb4e07e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:11.956518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1366/2692] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:12.768304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:12.777238 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:12.842687 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44e802-b38b-415e-8416-f1aea4a1acd8 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:12.847926 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:12.848908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:12.849185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:12.849471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] PATH_INFO: `/v3/users/52370b538bf74fc095dfb9cf6eb470f1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:12.850743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=52370b538bf74fc095dfb9cf6eb470f1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:12.852711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:12.906780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52370b538bf74fc095dfb9cf6eb470f1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:12.914636 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52370b538bf74fc095dfb9cf6eb470f1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:12.923222 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52370b538bf74fc095dfb9cf6eb470f1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:12.944839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52370b538bf74fc095dfb9cf6eb470f1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:12.945600 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52370b538bf74fc095dfb9cf6eb470f1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:12.952173 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1327/2693] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:12 2022] DELETE /identity/v3/users/52370b538bf74fc095dfb9cf6eb470f1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:12.956819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:12.957457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:12.957590 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:12.975466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:12.976786 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:13.039362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1367/2694] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:13.049958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:13.051765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:13.112473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9cae4-c917-49b4-b59d-7835360fd9bf admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:13.116946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:13.117653 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:13.117946 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:13.118289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:13.128198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:13.129737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:13.139438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1328/2695] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:13.416166 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:13.417686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:13.431941 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaa11e-e566-4986-832a-5fc93bf90ca9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:13.437797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:13.438704 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:13.438987 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:13.439589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] PATH_INFO: `/v3/projects/a9765c22cd884cdda4e81a0a06f1a730` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:13.440973 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9765c22cd884cdda4e81a0a06f1a730)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:13.443010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:13.456601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:13.498357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9765c22cd884cdda4e81a0a06f1a730', 'request_id': 'req-bf732770-e764-4cd5-8303-b090d670dbb4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.505222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9765c22cd884cdda4e81a0a06f1a730', 'request_id': 'req-bf732770-e764-4cd5-8303-b090d670dbb4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.514715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9765c22cd884cdda4e81a0a06f1a730', 'request_id': 'req-bf732770-e764-4cd5-8303-b090d670dbb4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.539498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] The token cache is being invalidate because project a9765c22cd884cdda4e81a0a06f1a730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:13.540143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.541025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.545319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1368/2696] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:13 2022] DELETE /identity/v3/projects/a9765c22cd884cdda4e81a0a06f1a730 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:14:13.549470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:13.559706 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4abb7-d6af-4a08-a4c2-9ae7b77196af service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:13.587386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:13.625129 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:13.626070 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:13.626386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:13.626663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] PATH_INFO: `/v3/users/11e34e2c08e14dde8ae6f6fc2f5d7d94` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:13.627971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e34e2c08e14dde8ae6f6fc2f5d7d94)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:13.630550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:13.690818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e34e2c08e14dde8ae6f6fc2f5d7d94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.698049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e34e2c08e14dde8ae6f6fc2f5d7d94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.709097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e34e2c08e14dde8ae6f6fc2f5d7d94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.724018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e34e2c08e14dde8ae6f6fc2f5d7d94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.724747 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2510d404-4c3d-4db5-a4b1-803958013981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e34e2c08e14dde8ae6f6fc2f5d7d94'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:13.731181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1329/2697] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:13 2022] DELETE /identity/v3/users/11e34e2c08e14dde8ae6f6fc2f5d7d94 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:14.036520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.038069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:14.060498 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732770-e764-4cd5-8303-b090d670dbb4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.130018 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.130930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.131210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.131489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] PATH_INFO: `/v3/projects/d2a6b823c5a64b8e9b26dc99eec5a32a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.132708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a6b823c5a64b8e9b26dc99eec5a32a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.134653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.184212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a6b823c5a64b8e9b26dc99eec5a32a', 'request_id': 'req-14008efb-304f-4db0-908b-26defe392cb3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:14.192056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a6b823c5a64b8e9b26dc99eec5a32a', 'request_id': 'req-14008efb-304f-4db0-908b-26defe392cb3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:14.202212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a6b823c5a64b8e9b26dc99eec5a32a', 'request_id': 'req-14008efb-304f-4db0-908b-26defe392cb3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:14.220631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] The token cache is being invalidate because project d2a6b823c5a64b8e9b26dc99eec5a32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:14.221120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:14.221915 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:14.224092 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1369/2698] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:14 2022] DELETE /identity/v3/projects/d2a6b823c5a64b8e9b26dc99eec5a32a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:14.229161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df914f65-a314-493e-ab53-d1c381525f60 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.229627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df914f65-a314-493e-ab53-d1c381525f60 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.229723 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df914f65-a314-493e-ab53-d1c381525f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.255735 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-df914f65-a314-493e-ab53-d1c381525f60 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:14.256992 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df914f65-a314-493e-ab53-d1c381525f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:14.261391 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.263728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:14.303563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:14.323293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1330/2699] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:14.335503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008efb-304f-4db0-908b-26defe392cb3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.336400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e013c-b6ed-45ad-898a-85a55a7c751e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.336796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e013c-b6ed-45ad-898a-85a55a7c751e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.337184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e013c-b6ed-45ad-898a-85a55a7c751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.339865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.340599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.340897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.341240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.343224 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:14.357148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.357332 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d48e013c-b6ed-45ad-898a-85a55a7c751e None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:14.358504 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d48e013c-b6ed-45ad-898a-85a55a7c751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:14.358719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.367537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1331/2700] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:14.368834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1370/2701] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:14:14.371783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e013c-b6ed-45ad-898a-85a55a7c751e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.383531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e013c-b6ed-45ad-898a-85a55a7c751e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.388629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.389304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.389588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.389866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.390648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:14:14.390986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.392613 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.406161 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1332/2702] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:14:14.409945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.421918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32db6a-75d3-424c-8efa-2ed1ed62fa86 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.427118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.427905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.428260 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.428604 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.429412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.431473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.460939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1371/2703] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:14:14 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:14.465237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.476307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a2c84-3e33-47eb-b54c-8227c707cddb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.508344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:14.548472 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.549168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.549458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.549864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.550662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.552771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.574391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1333/2704] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:14:14 2022] POST /identity/v3/users => generated 280 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:14.578485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.589175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc412a60-bbd1-468f-9292-6686e97d45f0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.594789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.595468 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.595754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.596033 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.596819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.599041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.610241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1372/2705] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:14.614872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.625851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827166f-895d-4cc1-94ff-083ed3a10a1f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.631414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46da6b-74b1-40f3-800a-a045f54dba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.632213 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46da6b-74b1-40f3-800a-a045f54dba73 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.632498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46da6b-74b1-40f3-800a-a045f54dba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.632775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46da6b-74b1-40f3-800a-a045f54dba73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.633510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46da6b-74b1-40f3-800a-a045f54dba73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.635191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46da6b-74b1-40f3-800a-a045f54dba73 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.646909 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1334/2706] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:14.651369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.662055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990238f-e46f-45d2-9436-f103022a989b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.667006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.667924 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.668203 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.668475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] PATH_INFO: `/v3/projects/1cab975ca5794fc5b49858004edef08b/users/1393f7daac244ba98bd7c96952b6b536/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.684504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cab975ca5794fc5b49858004edef08b, user_id=1393f7daac244ba98bd7c96952b6b536, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.687197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.702091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1373/2707] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:14 2022] PUT /identity/v3/projects/1cab975ca5794fc5b49858004edef08b/users/1393f7daac244ba98bd7c96952b6b536/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:14.713776 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06176a2-a7a2-4e69-8f35-d72cd86a1c21 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.714166 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06176a2-a7a2-4e69-8f35-d72cd86a1c21 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.714617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06176a2-a7a2-4e69-8f35-d72cd86a1c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.744342 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f06176a2-a7a2-4e69-8f35-d72cd86a1c21 None None] MFA Rules not processed for user `1393f7daac244ba98bd7c96952b6b536`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:14.745576 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f06176a2-a7a2-4e69-8f35-d72cd86a1c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:14.818260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1335/2708] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:14.859465 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:14.861359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:14.936099 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066df77-744d-44ae-8ae8-c745dcae5fe5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:14.941499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d8fda-a2e7-4c7c-bd39-fd7191832f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:14.942960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d8fda-a2e7-4c7c-bd39-fd7191832f45 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:14.943483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d8fda-a2e7-4c7c-bd39-fd7191832f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:14.943930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d8fda-a2e7-4c7c-bd39-fd7191832f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:14.958637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d8fda-a2e7-4c7c-bd39-fd7191832f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:14.961269 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d8fda-a2e7-4c7c-bd39-fd7191832f45 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:14.974177 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1374/2709] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:14.992327 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06176a2-a7a2-4e69-8f35-d72cd86a1c21 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:15.068800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06176a2-a7a2-4e69-8f35-d72cd86a1c21 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:15.073602 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:15.074766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:15.074894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:15.075081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] PATH_INFO: `/v3/users/1393f7daac244ba98bd7c96952b6b536` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:15.076353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1393f7daac244ba98bd7c96952b6b536)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:15.078239 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:15.161731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:15.172464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1393f7daac244ba98bd7c96952b6b536'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.183206 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1393f7daac244ba98bd7c96952b6b536'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.196433 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1393f7daac244ba98bd7c96952b6b536'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.210606 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1393f7daac244ba98bd7c96952b6b536'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.211350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1393f7daac244ba98bd7c96952b6b536'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.217888 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1336/2710] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:14 2022] DELETE /identity/v3/users/1393f7daac244ba98bd7c96952b6b536 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:15.222385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:15.223626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:15.223626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:15.243017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:15.244370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:15.312573 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1375/2711] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:15.322229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:15.323818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:15.384882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dbd4a-32cd-490e-8faf-7eeb3b282cc5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:15.388557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8f768-201b-4257-815c-90cf82e5534a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:15.389218 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f768-201b-4257-815c-90cf82e5534a service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:15.389498 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f768-201b-4257-815c-90cf82e5534a service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:15.389772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f768-201b-4257-815c-90cf82e5534a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:15.399863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8f768-201b-4257-815c-90cf82e5534a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:15.401337 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8f768-201b-4257-815c-90cf82e5534a service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:15.413029 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1337/2712] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:15.713922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:15.715428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:15.728467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c50158-1c0a-4efa-9d7e-afde2a375621 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:15.733913 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:15.734825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:15.735283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:15.735566 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] PATH_INFO: `/v3/projects/1cab975ca5794fc5b49858004edef08b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:15.736838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cab975ca5794fc5b49858004edef08b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:15.739223 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:15.757002 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:15.791186 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cab975ca5794fc5b49858004edef08b', 'request_id': 'req-b5383f48-d3f5-4501-b6fb-84360a0ad119'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.797577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cab975ca5794fc5b49858004edef08b', 'request_id': 'req-b5383f48-d3f5-4501-b6fb-84360a0ad119'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.806593 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cab975ca5794fc5b49858004edef08b', 'request_id': 'req-b5383f48-d3f5-4501-b6fb-84360a0ad119'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.817435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] The token cache is being invalidate because project 1cab975ca5794fc5b49858004edef08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:15.817725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.818421 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b5383f48-d3f5-4501-b6fb-84360a0ad119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:15.820011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1376/2713] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:15 2022] DELETE /identity/v3/projects/1cab975ca5794fc5b49858004edef08b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:15.825020 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0a1ab-0316-438c-8486-5fcb42804839 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:15.825317 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0a1ab-0316-438c-8486-5fcb42804839 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:15.825601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0a1ab-0316-438c-8486-5fcb42804839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:15.844678 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e8a0a1ab-0316-438c-8486-5fcb42804839 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:15.845932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e8a0a1ab-0316-438c-8486-5fcb42804839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:15.909738 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1338/2714] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:15.917850 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48878b4d-f676-4190-89cc-c4e5eaadf8e0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:15.918178 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48878b4d-f676-4190-89cc-c4e5eaadf8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:15.918462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48878b4d-f676-4190-89cc-c4e5eaadf8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:15.937998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-48878b4d-f676-4190-89cc-c4e5eaadf8e0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:15.939275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-48878b4d-f676-4190-89cc-c4e5eaadf8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:15.948381 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1377/2715] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:15.953087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0a1ab-0316-438c-8486-5fcb42804839 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:15.969060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0a1ab-0316-438c-8486-5fcb42804839 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:15.975622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:15.976291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:15.976570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:15.976851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:15.977572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:14:15.977884 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:15.979551 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:15.992323 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1339/2716] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:14:15.996815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48878b4d-f676-4190-89cc-c4e5eaadf8e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.006664 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48878b4d-f676-4190-89cc-c4e5eaadf8e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.011653 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.012305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.012620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.012900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.013597 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.015535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.043751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1378/2717] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:14:15 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:14:16.048170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.058833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf98dc-5048-4937-b299-ecd4b7a3a830 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.110816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:16.126750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.127550 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.127848 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.128123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.128894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.130872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.157897 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1340/2718] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:14:16 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:16.159150 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.170248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26066320-ed8b-474e-bc88-c04bb0a89888 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.175758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.176429 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.176705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.176977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.177695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.179336 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.193276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1379/2719] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:16.195931 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.205899 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dfb62-7514-4b6a-ab8f-8a07a20eb54b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.210781 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e26370-c17b-44c0-8ffd-edab15bd361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.211448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26370-c17b-44c0-8ffd-edab15bd361f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.211770 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26370-c17b-44c0-8ffd-edab15bd361f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.212048 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26370-c17b-44c0-8ffd-edab15bd361f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.212782 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e26370-c17b-44c0-8ffd-edab15bd361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.214426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e26370-c17b-44c0-8ffd-edab15bd361f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.224331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1341/2720] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:16.228492 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.239550 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec5a62-9a9c-4fea-a48f-5754e3252582 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.245301 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.246218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.246508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.246787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] PATH_INFO: `/v3/projects/e0f93394d3304415b1468bc99da003c9/users/df25c73385c0411e8f59797b0dd74f90/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.262812 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f93394d3304415b1468bc99da003c9, user_id=df25c73385c0411e8f59797b0dd74f90, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.265483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.282136 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1380/2721] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:16 2022] PUT /identity/v3/projects/e0f93394d3304415b1468bc99da003c9/users/df25c73385c0411e8f59797b0dd74f90/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:14:16.292679 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c4e5-23f5-43e2-89e4-a32b58ce5d4e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.293006 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c4e5-23f5-43e2-89e4-a32b58ce5d4e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.293296 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c4e5-23f5-43e2-89e4-a32b58ce5d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.320034 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3c93c4e5-23f5-43e2-89e4-a32b58ce5d4e None None] MFA Rules not processed for user `df25c73385c0411e8f59797b0dd74f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:16.321260 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3c93c4e5-23f5-43e2-89e4-a32b58ce5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:16.393586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1342/2722] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:16.398334 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.459405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154ec75-4c18-4343-af43-c477124d756d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.464145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.464797 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.465076 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.465346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.466158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.468086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.497222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1381/2723] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:14:16 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:16.501326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93c4e5-23f5-43e2-89e4-a32b58ce5d4e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.512457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93c4e5-23f5-43e2-89e4-a32b58ce5d4e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.575780 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.576458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.576743 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.577014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.577712 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.579734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.603207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1343/2724] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:14:16 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:16.607206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.618504 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452447d-aeaa-4869-9578-1c546e3417dd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.624074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.624744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.625030 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.625333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.626129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.627816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.639109 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1382/2725] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:16.643722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.655311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a4f77-d7b0-4cd9-ac73-f365224aa55b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.661045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84769b0-4382-4e00-8609-57c6ded5c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.661765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84769b0-4382-4e00-8609-57c6ded5c92f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.662067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84769b0-4382-4e00-8609-57c6ded5c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.662393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84769b0-4382-4e00-8609-57c6ded5c92f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.663130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84769b0-4382-4e00-8609-57c6ded5c92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.664752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84769b0-4382-4e00-8609-57c6ded5c92f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.675170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1344/2726] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:16.679649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.690174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502a1f-6d31-4c09-8808-d8a5ada4ef90 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.695795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.696687 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.696970 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.697248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] PATH_INFO: `/v3/projects/6c6b0bdaee0242e3a89fb8e9bb851d8e/users/8d0228c99ede4a59b9b7f67ca43d4525/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.708954 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:16.713490 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6b0bdaee0242e3a89fb8e9bb851d8e, user_id=8d0228c99ede4a59b9b7f67ca43d4525, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.716875 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.734165 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1383/2727] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:16 2022] PUT /identity/v3/projects/6c6b0bdaee0242e3a89fb8e9bb851d8e/users/8d0228c99ede4a59b9b7f67ca43d4525/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:16.745969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd7c3-7b7b-4602-8a10-a68d06181639 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.746329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd7c3-7b7b-4602-8a10-a68d06181639 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.746615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd7c3-7b7b-4602-8a10-a68d06181639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.773421 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-12bbd7c3-7b7b-4602-8a10-a68d06181639 None None] MFA Rules not processed for user `8d0228c99ede4a59b9b7f67ca43d4525`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:16.774818 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-12bbd7c3-7b7b-4602-8a10-a68d06181639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:16.796109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:16.842766 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1345/2728] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:16.847770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.912869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d83ee0-6ed9-4e74-b44a-a5d1d4fe69fb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:16.917978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:16.918666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:16.918957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:16.919227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:16.919907 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:16.921818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:16.949937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1384/2729] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:14:16 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:16.954198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd7c3-7b7b-4602-8a10-a68d06181639 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:16.965674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd7c3-7b7b-4602-8a10-a68d06181639 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:17.025975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:17.026676 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.026967 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.027234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.027924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:17.029908 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:17.053202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1346/2730] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:14:16 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:14:17.058168 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:17.069623 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52c5dc-6938-4457-9141-70dc29e35333 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:17.075448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:17.076113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.076412 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.076675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.077403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:17.079147 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:17.092774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1385/2731] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:17.097181 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:17.107983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea0c7-4c29-4e1e-acdd-9d0808604f4a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:17.114460 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:17.115370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.115658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.115938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] PATH_INFO: `/v3/projects/318eca29279045ce92508a529feab4f4/users/0147ed4e54484522a3b5f90b2ed2b3ea/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.133224 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318eca29279045ce92508a529feab4f4, user_id=0147ed4e54484522a3b5f90b2ed2b3ea, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:17.135997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:17.151993 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1347/2732] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:17 2022] PUT /identity/v3/projects/318eca29279045ce92508a529feab4f4/users/0147ed4e54484522a3b5f90b2ed2b3ea/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:17.156069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:17.166255 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657863bf-bda5-4d8b-9de3-0194ecea30e5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:17.222976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243942f-df61-47e6-a24e-d77db0f33990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:17.223790 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243942f-df61-47e6-a24e-d77db0f33990 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.224077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243942f-df61-47e6-a24e-d77db0f33990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.224357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243942f-df61-47e6-a24e-d77db0f33990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.225088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243942f-df61-47e6-a24e-d77db0f33990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:17.226796 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243942f-df61-47e6-a24e-d77db0f33990 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:17.237080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1386/2733] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:14:17.241997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:17.252526 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03d90-bf0c-4f17-a4b4-74c73215c256 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:17.257312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:17.258284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.258568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.258843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] PATH_INFO: `/v3/projects/318eca29279045ce92508a529feab4f4/users/0147ed4e54484522a3b5f90b2ed2b3ea/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.260869 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=318eca29279045ce92508a529feab4f4, user_id=0147ed4e54484522a3b5f90b2ed2b3ea, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:17.263556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:17.277382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1348/2734] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:14:17 2022] PUT /identity/v3/projects/318eca29279045ce92508a529feab4f4/users/0147ed4e54484522a3b5f90b2ed2b3ea/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:14:17.287725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.288015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.288297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.314577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] MFA Rules not processed for user `0147ed4e54484522a3b5f90b2ed2b3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:17.315852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:17.364952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:17.391329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1387/2735] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:17.405146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:17.406955 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:17.466234 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29024f8-e74c-4da6-8a35-5d75ff34bc6c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:17.470021 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:17.470792 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.471075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.471345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.502060 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:17.532227 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:17.533694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:17.544078 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1349/2736] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:19.052175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:19.053617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:19.065500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9c4a3-f602-420d-ab6a-1fcba15b337d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:19.069241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:19.069882 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:19.070202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:19.070482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:19.128534 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:19.130010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:19.139889 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1388/2737] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:19.695287 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:19.704616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172876ab-22d4-4d88-9f86-3ad025f3bf47 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:19.708696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:19.709445 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:19.709731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:19.710009 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:19.719691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:19.721171 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:19.732038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1350/2738] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:14:21.545121 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:21.556210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aa0c1-28bb-4b4b-8d6e-8a3266931ec4 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:21.560966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901421-f7f2-43bf-abe1-51a561a244a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:21.561588 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901421-f7f2-43bf-abe1-51a561a244a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:21.561905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901421-f7f2-43bf-abe1-51a561a244a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:21.562212 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901421-f7f2-43bf-abe1-51a561a244a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:21.564425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0901421-f7f2-43bf-abe1-51a561a244a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:21.628223 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901421-f7f2-43bf-abe1-51a561a244a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:21.629691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901421-f7f2-43bf-abe1-51a561a244a6 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:21.639156 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1389/2739] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:27.036368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:27.127076 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0fb7-5cc0-401f-99c8-35313a71e7b1 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:27.132340 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:27.133226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:27.133512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:27.133794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] PATH_INFO: `/v3/users/df25c73385c0411e8f59797b0dd74f90` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:27.135019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df25c73385c0411e8f59797b0dd74f90)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:27.136985 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:27.195638 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df25c73385c0411e8f59797b0dd74f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:27.203977 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df25c73385c0411e8f59797b0dd74f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:27.214620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df25c73385c0411e8f59797b0dd74f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:27.228363 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df25c73385c0411e8f59797b0dd74f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:27.230407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df25c73385c0411e8f59797b0dd74f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:27.240505 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1351/2740] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:27 2022] DELETE /identity/v3/users/df25c73385c0411e8f59797b0dd74f90 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:27.245024 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:27.245521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:27.245607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:27.264692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:27.265920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:27.365519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1390/2741] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:27.377938 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:27.379711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:27.435694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:27.458975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f3b05-7963-42ed-bc0d-4d19ae699c4d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:27.463896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:27.464700 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:27.464996 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:27.465259 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:27.475301 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:27.476806 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:27.487197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1352/2742] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:27.914355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:27.916081 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:27.944331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:28.003522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531a369-bc8e-48ef-bdc8-5fdd81bedbd1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:28.009022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:28.009893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.010280 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.010561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] PATH_INFO: `/v3/projects/e0f93394d3304415b1468bc99da003c9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.011771 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f93394d3304415b1468bc99da003c9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:28.013690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:28.070731 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:28.071838 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f93394d3304415b1468bc99da003c9', 'request_id': 'req-8e84f47f-661b-4d1a-82c8-9155aecfd515'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.072629 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:28.079259 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f93394d3304415b1468bc99da003c9', 'request_id': 'req-8e84f47f-661b-4d1a-82c8-9155aecfd515'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.090229 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f93394d3304415b1468bc99da003c9', 'request_id': 'req-8e84f47f-661b-4d1a-82c8-9155aecfd515'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.104482 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] The token cache is being invalidate because project e0f93394d3304415b1468bc99da003c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:28.104861 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.105937 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.110933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1391/2743] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:27 2022] DELETE /identity/v3/projects/e0f93394d3304415b1468bc99da003c9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:28.112154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:28.115596 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:28.181478 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886b67e-c1b8-4bde-b9a0-f3bec479521d service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:28.188545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f47f-661b-4d1a-82c8-9155aecfd515 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:28.193385 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:28.194319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.195011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.195011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] PATH_INFO: `/v3/users/8d0228c99ede4a59b9b7f67ca43d4525` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.196067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0228c99ede4a59b9b7f67ca43d4525)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:28.198003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:28.250539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:28.252140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0228c99ede4a59b9b7f67ca43d4525'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.262356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0228c99ede4a59b9b7f67ca43d4525'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.272064 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0228c99ede4a59b9b7f67ca43d4525'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.285329 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:28.286307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.286744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.287123 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.287980 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0228c99ede4a59b9b7f67ca43d4525'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.289104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:28.289697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0228c99ede4a59b9b7f67ca43d4525'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.297160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1392/2744] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:28 2022] DELETE /identity/v3/users/8d0228c99ede4a59b9b7f67ca43d4525 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:28.303902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:28.305667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:28.318063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1353/2745] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:28.620446 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:28.621988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:28.697433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab002b18-2c4e-46cc-9e9e-58ca11b96563 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:28.703357 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:28.704282 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.705196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.705489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] PATH_INFO: `/v3/projects/6c6b0bdaee0242e3a89fb8e9bb851d8e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.706901 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6b0bdaee0242e3a89fb8e9bb851d8e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:28.708729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:28.765477 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6b0bdaee0242e3a89fb8e9bb851d8e', 'request_id': 'req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.772610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6b0bdaee0242e3a89fb8e9bb851d8e', 'request_id': 'req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.783313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6b0bdaee0242e3a89fb8e9bb851d8e', 'request_id': 'req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.800144 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] The token cache is being invalidate because project 6c6b0bdaee0242e3a89fb8e9bb851d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:28.800520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.801241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.802931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1393/2746] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:28 2022] DELETE /identity/v3/projects/6c6b0bdaee0242e3a89fb8e9bb851d8e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:28.807064 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:28.818690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bb14d-927b-4573-b832-a73eb82edb4b service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:28.843968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:28.889100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:28.889912 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.890468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.891002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] PATH_INFO: `/v3/users/0147ed4e54484522a3b5f90b2ed2b3ea` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.892829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0147ed4e54484522a3b5f90b2ed2b3ea)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:28.895544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:28.947863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0147ed4e54484522a3b5f90b2ed2b3ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.956066 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0147ed4e54484522a3b5f90b2ed2b3ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.965203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0147ed4e54484522a3b5f90b2ed2b3ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.978256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0147ed4e54484522a3b5f90b2ed2b3ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.978978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c770026e-360e-40b9-b414-80590dd888c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0147ed4e54484522a3b5f90b2ed2b3ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:28.984943 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1354/2747] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:14:28 2022] DELETE /identity/v3/users/0147ed4e54484522a3b5f90b2ed2b3ea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:14:29.284787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:29.286507 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:29.300642 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c49688-39ab-42fd-9c63-f8b0f50cfe25 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:29.356529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:29.367417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:29.368306 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:29.369001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:29.369335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] PATH_INFO: `/v3/projects/318eca29279045ce92508a529feab4f4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:29.370766 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318eca29279045ce92508a529feab4f4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:29.373535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:29.421122 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318eca29279045ce92508a529feab4f4', 'request_id': 'req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:29.428013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318eca29279045ce92508a529feab4f4', 'request_id': 'req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:29.437025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318eca29279045ce92508a529feab4f4', 'request_id': 'req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:29.447865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] The token cache is being invalidate because project 318eca29279045ce92508a529feab4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:14:29.448152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:29.448774 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:14:29.450537 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1394/2748] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:14:29 2022] DELETE /identity/v3/projects/318eca29279045ce92508a529feab4f4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:14:31.699611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:31.700163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:31.700163 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:31.718974 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] MFA Rules not processed for user `62f5e92899b84d5594a34643b662d233`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:31.720191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:31.783721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1355/2749] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:32.356154 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:32.358448 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:32.456729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6e24-d5f8-4d70-9b0f-b078464bd809 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:32.461532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:32.462307 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:32.462621 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:32.462897 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:32.465067 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:32.475424 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:32.476865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:32.485977 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1395/2750] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:32.970574 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:32.972019 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:33.028465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:33.053112 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8160e-47f1-4eee-8776-b95f59783e8e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:33.058443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:33.059100 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:33.059388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:33.059668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:33.061561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:33.073436 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:33.075063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:33.085414 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1356/2751] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:42.482641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:43.081143 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=11 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:46.915065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:46.916667 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:46.993750 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c43c6-463d-48ac-ab40-39f898e6b211 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:47.001639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:47.002346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:47.002631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:47.002908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:47.004952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:47.019276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:47.020935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:47.032435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1396/2752] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:49.727370 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:49.738303 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b7e2b-6f4e-4a0e-9a76-8d376fc77624 service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:49.742293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6196d06-c6a4-4559-a70c-1da33f1da330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:49.742975 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196d06-c6a4-4559-a70c-1da33f1da330 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:49.743262 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196d06-c6a4-4559-a70c-1da33f1da330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:49.743541 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196d06-c6a4-4559-a70c-1da33f1da330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:49.745495 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e6196d06-c6a4-4559-a70c-1da33f1da330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:49.816803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6196d06-c6a4-4559-a70c-1da33f1da330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:49.818291 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6196d06-c6a4-4559-a70c-1da33f1da330 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:49.828188 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1357/2753] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:57.027905 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=34 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:59.824087 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=30 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:43.165729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:43.177693 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f85d3-8682-4594-93d6-a72eb628d461 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:43.184925 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:43.185572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:43.185880 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:43.186137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:43.188261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:43.252021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:43.253724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:43.263923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1397/2754] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:53.259202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=28 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:08.983716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:08.984372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:08.984372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:09.008512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:09.009963 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:09.094558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1358/2755] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:16:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:09.155645 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:09.157188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:09.232386 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a47b26-d38a-4d18-8bb0-7e9d091df5be service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:09.238011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bfd09-65db-4839-8fe6-48042c60dfae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:09.238729 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfd09-65db-4839-8fe6-48042c60dfae service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:09.239167 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfd09-65db-4839-8fe6-48042c60dfae service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:09.239632 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfd09-65db-4839-8fe6-48042c60dfae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:09.249073 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bfd09-65db-4839-8fe6-48042c60dfae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:09.250701 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bfd09-65db-4839-8fe6-48042c60dfae service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:09.261706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1398/2756] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:16:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:16:19.086622 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=25 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:19.255622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=32 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:20.788050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:20.789847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:20.829525 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0e6b8-5c21-4f92-a83a-6df4e3a45ad4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:20.835716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f4730-3f5c-48b7-9c25-139dc76c56cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:20.836376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f4730-3f5c-48b7-9c25-139dc76c56cd service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:20.836662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f4730-3f5c-48b7-9c25-139dc76c56cd service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:20.837272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f4730-3f5c-48b7-9c25-139dc76c56cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:20.838929 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e46f4730-3f5c-48b7-9c25-139dc76c56cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:20.850879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f4730-3f5c-48b7-9c25-139dc76c56cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:20.852608 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f4730-3f5c-48b7-9c25-139dc76c56cd service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:20.863252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1359/2757] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:22.296161 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088b4dc-a176-442c-9d4d-f46db6ce56b3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.296751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088b4dc-a176-442c-9d4d-f46db6ce56b3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.296751 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088b4dc-a176-442c-9d4d-f46db6ce56b3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.298368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1399/2758] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:22.304132 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945bf4e-bd40-4552-b3dd-237af908105c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.304644 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945bf4e-bd40-4552-b3dd-237af908105c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.304902 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945bf4e-bd40-4552-b3dd-237af908105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.335032 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7945bf4e-bd40-4552-b3dd-237af908105c None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:22.336225 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7945bf4e-bd40-4552-b3dd-237af908105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:22.347843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1360/2759] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:22.362594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088b4dc-a176-442c-9d4d-f46db6ce56b3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:22.364939 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0088b4dc-a176-442c-9d4d-f46db6ce56b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:22.425116 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088b4dc-a176-442c-9d4d-f46db6ce56b3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:22.428695 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f7886-939e-43ca-8a40-acc9081ad0c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ea8ab7aaf7415ea86a0975dfe54a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:22.429410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7886-939e-43ca-8a40-acc9081ad0c9 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.429698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7886-939e-43ca-8a40-acc9081ad0c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.429976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7886-939e-43ca-8a40-acc9081ad0c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.440893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f7886-939e-43ca-8a40-acc9081ad0c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:22.442485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f7886-939e-43ca-8a40-acc9081ad0c9 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:22.453257 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1400/2760] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:22.527423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9d30-066d-4412-a91c-35e94124bb48 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.527699 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9d30-066d-4412-a91c-35e94124bb48 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.527979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9d30-066d-4412-a91c-35e94124bb48 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.529360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1361/2761] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:22.534658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859bab-89dd-4baf-920e-b08cb6d7fcd0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.535022 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859bab-89dd-4baf-920e-b08cb6d7fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.535370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859bab-89dd-4baf-920e-b08cb6d7fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.575332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21859bab-89dd-4baf-920e-b08cb6d7fcd0 None None] MFA Rules not processed for user `2fa3a98382cd4b04bb384bbc2ab3a598`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:22.576563 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21859bab-89dd-4baf-920e-b08cb6d7fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:22.584530 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1401/2762] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:22.596339 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a9d30-066d-4412-a91c-35e94124bb48 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:22.598491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-429a9d30-066d-4412-a91c-35e94124bb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:22.613645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a9d30-066d-4412-a91c-35e94124bb48 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:22.617609 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6450252-cca2-4385-bebb-78224a3c5ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:22.618431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450252-cca2-4385-bebb-78224a3c5ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.618573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450252-cca2-4385-bebb-78224a3c5ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.618879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450252-cca2-4385-bebb-78224a3c5ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.626344 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6450252-cca2-4385-bebb-78224a3c5ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:22.627775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6450252-cca2-4385-bebb-78224a3c5ea3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:22.635834 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1362/2763] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:22.720374 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149bcb-15d7-4fbd-b020-5333839b0bdd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.720674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149bcb-15d7-4fbd-b020-5333839b0bdd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.720945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149bcb-15d7-4fbd-b020-5333839b0bdd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.722413 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1402/2764] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 3 13:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:22.728089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947ee5e-a667-4610-aebd-8c852c518b5f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.728386 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947ee5e-a667-4610-aebd-8c852c518b5f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.728663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947ee5e-a667-4610-aebd-8c852c518b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.750249 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5947ee5e-a667-4610-aebd-8c852c518b5f None None] MFA Rules not processed for user `8948febd509a4edca08572764acfdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:22.751477 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5947ee5e-a667-4610-aebd-8c852c518b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:22.762937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1363/2765] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 3 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:22.773591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149bcb-15d7-4fbd-b020-5333839b0bdd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:22.786674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149bcb-15d7-4fbd-b020-5333839b0bdd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:22.791541 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:22.792174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.792453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.792692 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.803992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:22.805521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:22.816464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1403/2766] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:24.436637 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bbb70-7364-4802-aa62-551d55ee92c0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:24.437183 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bbb70-7364-4802-aa62-551d55ee92c0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:24.437279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bbb70-7364-4802-aa62-551d55ee92c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:24.459570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f23bbb70-7364-4802-aa62-551d55ee92c0 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:24.460831 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f23bbb70-7364-4802-aa62-551d55ee92c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:24.469847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1364/2767] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:24.483066 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:24.496700 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198ad19-4d37-4b8e-ab71-01fb13795844 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:24.508077 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:24.508860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:24.509784 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:24.510152 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:24.519739 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:24.521681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:24.531219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1404/2768] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:16:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:16:34.452140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=34 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:34.527423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=47 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:44.792787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f120-2206-476f-b590-1956800f72e1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:44.793319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f120-2206-476f-b590-1956800f72e1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:44.793319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f120-2206-476f-b590-1956800f72e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:44.813380 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0461f120-2206-476f-b590-1956800f72e1 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:44.814641 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0461f120-2206-476f-b590-1956800f72e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:44.822758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1365/2769] 10.222.0.58 () {58 vars in 967 bytes} [Fri Jun 3 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:44.835096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:44.845761 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4381d-91c7-4034-8d25-b4417fef9087 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:44.851032 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:44.851668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:44.851946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:44.852218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:44.860567 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:44.862187 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:44.870736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1405/2770] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 13:16:53.968086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461f120-2206-476f-b590-1956800f72e1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:53.977649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461f120-2206-476f-b590-1956800f72e1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:53.981557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:53.982237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:53.982520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:53.982790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:53.984533 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:54.048036 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:54.049468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:54.059438 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1366/2771] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:54.867370 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:56.973549 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:56.986020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71d764-b68d-4d48-85e0-dbef64fa1089 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:56.991776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:56.992438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:56.992726 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:56.993007 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:56.995736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:57.008652 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:57.010668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:57.043810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1406/2772] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:17:00.303664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:00.305247 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:00.327812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e9f43-513a-45ed-97dc-81228762b394 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:00.332750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:00.333849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:00.334202 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:00.334490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] PATH_INFO: `/v3/users/62f5e92899b84d5594a34643b662d233` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:00.335696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f5e92899b84d5594a34643b662d233)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:00.337904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:00.387165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f5e92899b84d5594a34643b662d233'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.394453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f5e92899b84d5594a34643b662d233'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.404049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f5e92899b84d5594a34643b662d233'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.417520 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f5e92899b84d5594a34643b662d233'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.418416 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f5e92899b84d5594a34643b662d233'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.424857 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1367/2773] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:17:00 2022] DELETE /identity/v3/users/62f5e92899b84d5594a34643b662d233 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:17:00.609159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:00.624934 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54859db7-6ead-48ae-9e2a-a9aa4a09b347 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:00.685369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:00.686293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:00.686576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:00.686837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] PATH_INFO: `/v3/projects/2fd9de1783e54cafadd25ecc97876288` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:00.688029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd9de1783e54cafadd25ecc97876288)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:00.689967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:00.739702 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd9de1783e54cafadd25ecc97876288', 'request_id': 'req-f9960cce-4082-46e0-933a-e1bb71b87279'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.747055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd9de1783e54cafadd25ecc97876288', 'request_id': 'req-f9960cce-4082-46e0-933a-e1bb71b87279'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.757042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd9de1783e54cafadd25ecc97876288', 'request_id': 'req-f9960cce-4082-46e0-933a-e1bb71b87279'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.768535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] The token cache is being invalidate because project 2fd9de1783e54cafadd25ecc97876288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:17:00.768820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.769521 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.771440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1407/2774] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:17:00 2022] DELETE /identity/v3/projects/2fd9de1783e54cafadd25ecc97876288 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:17:00.775552 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:00.777859 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:00.793827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382b4a-17a5-45a4-ab89-f0cd6ceec483 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:00.854997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:00.855905 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:00.856189 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:00.856465 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] PATH_INFO: `/v3/users/c1325c291f9f4db0a9b122b3aee2c9af` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:00.857789 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1325c291f9f4db0a9b122b3aee2c9af)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:00.859791 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:00.861457 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:00.910829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1325c291f9f4db0a9b122b3aee2c9af'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.918045 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1325c291f9f4db0a9b122b3aee2c9af'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.926785 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1325c291f9f4db0a9b122b3aee2c9af'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.939876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1325c291f9f4db0a9b122b3aee2c9af'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.940647 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1325c291f9f4db0a9b122b3aee2c9af'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:00.947310 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1368/2775] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:17:00 2022] DELETE /identity/v3/users/c1325c291f9f4db0a9b122b3aee2c9af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:17:01.138053 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:01.139634 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:01.153660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9960cce-4082-46e0-933a-e1bb71b87279 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:01.212163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:01.213261 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:01.213545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:01.213804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] PATH_INFO: `/v3/projects/f9c9aa090565493d9d388b4723e12338` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:01.215093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c9aa090565493d9d388b4723e12338)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:01.217006 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:01.238884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:01.269434 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c9aa090565493d9d388b4723e12338', 'request_id': 'req-4cda0097-92b1-4f33-88e6-e8035f81b0e6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:01.275804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c9aa090565493d9d388b4723e12338', 'request_id': 'req-4cda0097-92b1-4f33-88e6-e8035f81b0e6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:01.284557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c9aa090565493d9d388b4723e12338', 'request_id': 'req-4cda0097-92b1-4f33-88e6-e8035f81b0e6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:01.295752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] The token cache is being invalidate because project f9c9aa090565493d9d388b4723e12338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:17:01.296041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:01.296678 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:01.298275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1408/2776] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:17:01 2022] DELETE /identity/v3/projects/f9c9aa090565493d9d388b4723e12338 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:17:10.943560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:11.292835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:42.483390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:42.485081 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:42.552740 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2339-a34b-4f3c-a9b8-dd3020be7644 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:42.614623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:42.615547 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:42.615970 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:42.616394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:42.618913 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:42.717444 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:42.718935 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:42.740721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1369/2777] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:17:43.941610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:43.943316 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:43.957376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0097-92b1-4f33-88e6-e8035f81b0e6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:43.961719 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:43.962405 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:43.962690 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:43.962971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:43.965010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:43.980668 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:43.982299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:43.994650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1409/2778] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:17:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:17:49.390191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:49.400106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d080d-918c-473b-97be-b77eac539f8d service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:49.405154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:49.405809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:49.406098 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:49.406413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:49.408680 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:49.440964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:49.485787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:49.487319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:49.498001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1370/2779] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:17:52.760453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:52.764368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:52.781016 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7cc63-2d19-4d31-906b-973cdf464813 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:52.789571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:52.789571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:52.789571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:52.789571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] PATH_INFO: `/v3/users/49b596abb9a5466595eec1a8fb25d5a1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:52.790183 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b596abb9a5466595eec1a8fb25d5a1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:52.792135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:52.846052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b596abb9a5466595eec1a8fb25d5a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:52.853335 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b596abb9a5466595eec1a8fb25d5a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:52.862211 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b596abb9a5466595eec1a8fb25d5a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:52.876486 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b596abb9a5466595eec1a8fb25d5a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:52.877171 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ebf64e5-f624-4529-9c97-33ce7877c215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b596abb9a5466595eec1a8fb25d5a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:52.883614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1410/2780] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:17:52 2022] DELETE /identity/v3/users/49b596abb9a5466595eec1a8fb25d5a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:17:53.083373 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.095480 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71408718-9179-4cdd-a7b1-d8c7cf8cb34c service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.155987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.156803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.157086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.157352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] PATH_INFO: `/v3/projects/020ed9813c614d2eae9568ba85728136` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.158567 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020ed9813c614d2eae9568ba85728136)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.160645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.210586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020ed9813c614d2eae9568ba85728136', 'request_id': 'req-de21c00c-b563-43f4-abea-e894090cef97'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:53.216661 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020ed9813c614d2eae9568ba85728136', 'request_id': 'req-de21c00c-b563-43f4-abea-e894090cef97'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:53.226849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020ed9813c614d2eae9568ba85728136', 'request_id': 'req-de21c00c-b563-43f4-abea-e894090cef97'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:53.241665 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] The token cache is being invalidate because project 020ed9813c614d2eae9568ba85728136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:17:53.242008 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:53.242823 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-de21c00c-b563-43f4-abea-e894090cef97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:17:53.244557 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1371/2781] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:17:53 2022] DELETE /identity/v3/projects/020ed9813c614d2eae9568ba85728136 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:17:53.250010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77330-05fa-4d99-a066-ab32a49185be None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.250466 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77330-05fa-4d99-a066-ab32a49185be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.250960 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77330-05fa-4d99-a066-ab32a49185be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.299815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b5f77330-05fa-4d99-a066-ab32a49185be None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:17:53.301743 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5f77330-05fa-4d99-a066-ab32a49185be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:53.365278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1411/2782] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:17:53.373156 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12f89-109c-4aea-bb3b-c31e9373e738 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.373450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12f89-109c-4aea-bb3b-c31e9373e738 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.373734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12f89-109c-4aea-bb3b-c31e9373e738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.393001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-32e12f89-109c-4aea-bb3b-c31e9373e738 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:17:53.394810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-32e12f89-109c-4aea-bb3b-c31e9373e738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:53.403185 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1372/2783] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:17:53.407529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77330-05fa-4d99-a066-ab32a49185be None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.417919 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77330-05fa-4d99-a066-ab32a49185be None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.423938 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.424606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.424899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.425206 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.425963 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:17:53.426332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.427950 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.440013 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1412/2784] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:17:53.444563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12f89-109c-4aea-bb3b-c31e9373e738 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.455069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12f89-109c-4aea-bb3b-c31e9373e738 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.460856 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.461512 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.461911 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.462233 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.462934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.464873 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.494343 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1373/2785] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:17:53 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:17:53.498575 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.511935 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb0a8-152f-4277-bb26-0497e7be04c0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.534083 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:53.577788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.578501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.578780 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.579052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.579752 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.581829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.609411 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1413/2786] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:17:53 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:17:53.615035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.629530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877f2b-47fb-41f8-908b-4ba3d8a8f3f6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.635882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.636877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.637272 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.637667 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.638812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.641154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.652942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1374/2787] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:17:53.657097 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.667711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c17995-2d40-40a5-ac8c-f65dcf4e2bb4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.673467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b250ca-e96e-4a50-8330-6943c56e6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.674146 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b250ca-e96e-4a50-8330-6943c56e6ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.674436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b250ca-e96e-4a50-8330-6943c56e6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.674851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b250ca-e96e-4a50-8330-6943c56e6ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.675644 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b250ca-e96e-4a50-8330-6943c56e6ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.677248 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b250ca-e96e-4a50-8330-6943c56e6ed2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.687613 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1414/2788] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:17:53.692458 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.708079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3e8d-6f15-49c5-b307-692a0204354a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.717093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.718470 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.718829 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.719153 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] PATH_INFO: `/v3/projects/8c86bae74a9443368c08e697fd4a9048/users/8742453c42ae4d9a8e4b996d628d5f90/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.733031 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:53.736443 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c86bae74a9443368c08e697fd4a9048, user_id=8742453c42ae4d9a8e4b996d628d5f90, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.739716 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.756686 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1375/2789] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:17:53 2022] PUT /identity/v3/projects/8c86bae74a9443368c08e697fd4a9048/users/8742453c42ae4d9a8e4b996d628d5f90/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:17:53.761943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bff4a-4913-40ca-a5ec-c4457aefc634 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.762459 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bff4a-4913-40ca-a5ec-c4457aefc634 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.762570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bff4a-4913-40ca-a5ec-c4457aefc634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.782134 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-525bff4a-4913-40ca-a5ec-c4457aefc634 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:17:53.783365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-525bff4a-4913-40ca-a5ec-c4457aefc634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:53.849123 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1415/2790] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:17:53.859002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:53.861059 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:53.922725 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99188c30-f23a-471a-ad05-ecf0e2bff667 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:53.928003 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:53.929459 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:53.929714 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:53.930142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:53.940722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:53.942314 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:53.952134 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1376/2791] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:17:57.959322 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a89d-f0b8-4b29-adeb-f0ce02962c35 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:57.959904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a89d-f0b8-4b29-adeb-f0ce02962c35 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:57.959904 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a89d-f0b8-4b29-adeb-f0ce02962c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:57.993571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea04a89d-f0b8-4b29-adeb-f0ce02962c35 None None] MFA Rules not processed for user `8742453c42ae4d9a8e4b996d628d5f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:17:57.994957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea04a89d-f0b8-4b29-adeb-f0ce02962c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:58.068921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1416/2792] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:17:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:17:58.084273 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:58.085993 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:58.163572 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900830a-6a82-4099-ad17-144aa24ce78b service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:58.169079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:58.169752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:58.170039 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:58.170352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:58.179040 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:58.180664 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:58.190646 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1377/2793] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:17:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:17:59.513637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816124-c4bd-4e55-9486-a0cf9634da97 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:59.514204 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816124-c4bd-4e55-9486-a0cf9634da97 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:59.514451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816124-c4bd-4e55-9486-a0cf9634da97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:59.534829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fd816124-c4bd-4e55-9486-a0cf9634da97 None None] MFA Rules not processed for user `8742453c42ae4d9a8e4b996d628d5f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:17:59.534829 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fd816124-c4bd-4e55-9486-a0cf9634da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:59.543368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1417/2794] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:17:59.868616 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:17:59.870352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:59.883621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59fbd-035d-487e-b413-39e785f98b60 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:17:59.887640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:17:59.888285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:17:59.888570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:17:59.888956 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:17:59.890801 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:17:59.902282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:17:59.903732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:17:59.912357 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1378/2795] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:18:09.527715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:09.908413 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=69,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:26.923852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd816124-c4bd-4e55-9486-a0cf9634da97 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:19:26.935182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd816124-c4bd-4e55-9486-a0cf9634da97 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:19:26.941708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:19:26.942529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:26.942898 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:26.943321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:26.946315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:26.960584 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:19:26.962029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:19:26.970622 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1418/2796] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:19:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:19:36.967047 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:32.180371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:32.181948 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:32.266072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e7714-0dbc-4e36-976e-4dcf26e9059e service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:32.273116 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4e3fd-90f3-4463-9380-adc0f9a825fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:32.273752 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e3fd-90f3-4463-9380-adc0f9a825fd service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:32.274093 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e3fd-90f3-4463-9380-adc0f9a825fd service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:32.274396 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e3fd-90f3-4463-9380-adc0f9a825fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:32.276573 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-01b4e3fd-90f3-4463-9380-adc0f9a825fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:32.288685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e3fd-90f3-4463-9380-adc0f9a825fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:32.290285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e3fd-90f3-4463-9380-adc0f9a825fd service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:32.300463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1379/2797] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:40.898918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.900437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:40.918601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a787-9a8d-4f95-b619-6a9b07a9aa31 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.924785 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.925514 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.925804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.926068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.928246 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:40.944955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.946930 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.960626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1419/2798] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.296655 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=32 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:44.247510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30be9ae-28fc-484e-8937-c99084123799 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:44.248146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30be9ae-28fc-484e-8937-c99084123799 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:44.248146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30be9ae-28fc-484e-8937-c99084123799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:44.266986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a30be9ae-28fc-484e-8937-c99084123799 None None] MFA Rules not processed for user `8742453c42ae4d9a8e4b996d628d5f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:44.268302 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a30be9ae-28fc-484e-8937-c99084123799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:44.276645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1380/2799] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:21:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:44.621414 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:44.631708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59611f00-36b2-43de-a776-ddc3a98e3658 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:44.635689 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:44.636291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:44.636608 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:44.636878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:44.638819 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:44.649232 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:44.650724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:44.658873 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1420/2800] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:45.000216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30be9ae-28fc-484e-8937-c99084123799 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:45.012917 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30be9ae-28fc-484e-8937-c99084123799 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:45.018374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:45.019035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:45.019321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:45.019695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:45.021737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:45.034694 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:45.036568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:45.050023 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1381/2801] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:53.208052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:53.224988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde946a-773b-467d-beca-0fe3c337dd43 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:53.231241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:53.231911 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:53.232196 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:53.232475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:53.234366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:53.256918 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:53.258620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:53.270014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1421/2802] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:55.042722 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=9 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:56.669803 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:56.682849 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655aefd-8a47-45c6-9d3e-3c6f89fe52cb service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:56.688851 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:56.689503 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:56.689783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:56.690058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:56.691876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:56.704901 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:56.706497 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:56.717431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1382/2803] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:03.265368 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=18 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:06.712668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:01.318393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:01.330478 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c0691-bdf3-4956-bc56-1159627039da service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:01.337527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:01.338216 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:01.338519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:01.338800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:01.347102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:01.348900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:01.358140 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1422/2804] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:02.785773 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:02.787410 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:02.880749 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9553-e366-4f0e-bb95-2c148051b2b4 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:02.884765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:02.885406 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:02.885688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:02.885962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:02.887986 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:02.901841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:02.903306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:02.914432 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1383/2805] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:11.354349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:12.211720 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:12.224059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137115ef-d33b-4e78-a0ac-f56440e0bfe5 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:12.229355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:12.230003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:12.230331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:12.230610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:12.232803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:12.249356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:12.250830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:12.262539 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1423/2806] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:12.909532 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=35 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:22.257451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:31.266962 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:31.277086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e68f-aa94-45c5-b545-e71483e4ce02 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:31.280845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:31.281489 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:31.281769 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:31.282047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:31.291658 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:31.293186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:31.302623 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1384/2807] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:34.436561 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:34.451225 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab68d77-aa9e-45a6-bab6-db74be345f37 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:34.456836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:34.457626 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:34.457979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:34.458342 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:34.460182 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:34.472966 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:34.474772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:34.486876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1424/2808] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:34.501372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:34.518024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1ab2-20ef-4a74-af13-221c5212cd79 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:34.523755 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:34.524695 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:34.525094 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:34.525366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] PATH_INFO: `/v3/users/8742453c42ae4d9a8e4b996d628d5f90` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:34.526754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8742453c42ae4d9a8e4b996d628d5f90)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:34.529063 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:34.581544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8742453c42ae4d9a8e4b996d628d5f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.588516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8742453c42ae4d9a8e4b996d628d5f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.596824 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8742453c42ae4d9a8e4b996d628d5f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.609424 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8742453c42ae4d9a8e4b996d628d5f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.610058 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3bf4fd8-f5bc-4a50-8efc-9f04e96d6a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8742453c42ae4d9a8e4b996d628d5f90'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.616304 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1385/2809] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:34 2022] DELETE /identity/v3/users/8742453c42ae4d9a8e4b996d628d5f90 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:34.807055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:34.817896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24860d-24cf-428b-86c6-4cde40926d11 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:34.877542 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:34.878447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:34.878728 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:34.879000 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] PATH_INFO: `/v3/projects/8c86bae74a9443368c08e697fd4a9048` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:34.880223 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c86bae74a9443368c08e697fd4a9048)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:34.882135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:34.932179 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c86bae74a9443368c08e697fd4a9048', 'request_id': 'req-2127577f-0622-4716-8d9b-af8cffd49ead'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.939713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c86bae74a9443368c08e697fd4a9048', 'request_id': 'req-2127577f-0622-4716-8d9b-af8cffd49ead'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.948684 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c86bae74a9443368c08e697fd4a9048', 'request_id': 'req-2127577f-0622-4716-8d9b-af8cffd49ead'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.959086 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] The token cache is being invalidate because project 8c86bae74a9443368c08e697fd4a9048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:34.959371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.960004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2127577f-0622-4716-8d9b-af8cffd49ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:34.961558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1425/2810] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:34 2022] DELETE /identity/v3/projects/8c86bae74a9443368c08e697fd4a9048 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:34.966937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae406d9-c7c4-4f6d-a72c-1f349906a0d6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:34.967216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae406d9-c7c4-4f6d-a72c-1f349906a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:34.967612 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae406d9-c7c4-4f6d-a72c-1f349906a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:34.987035 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-aae406d9-c7c4-4f6d-a72c-1f349906a0d6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:34.988271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-aae406d9-c7c4-4f6d-a72c-1f349906a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:35.051216 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1386/2811] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:35.059441 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f36ef-f557-42b4-afff-b1d30eb20ed2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.059858 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f36ef-f557-42b4-afff-b1d30eb20ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.060143 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f36ef-f557-42b4-afff-b1d30eb20ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.079485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c11f36ef-f557-42b4-afff-b1d30eb20ed2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:35.080818 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c11f36ef-f557-42b4-afff-b1d30eb20ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:35.090436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1426/2812] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:35.094867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae406d9-c7c4-4f6d-a72c-1f349906a0d6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:35.106887 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae406d9-c7c4-4f6d-a72c-1f349906a0d6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:35.112125 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:35.112793 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.113079 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.113356 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.114104 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:35.114439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:35.116407 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:35.128403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1387/2813] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:23:35.132789 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f36ef-f557-42b4-afff-b1d30eb20ed2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:35.142145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f36ef-f557-42b4-afff-b1d30eb20ed2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:35.147707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:35.148366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.148637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.148900 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.149585 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:35.151540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:35.195416 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1427/2814] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:35 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:35.200858 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:35.215783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0d94-b57f-4ed7-8eb3-1682f2b1728f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:35.261544 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:35.276157 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:35.276872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.277625 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.277915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.278649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:35.280615 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:35.306347 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1388/2815] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:35 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:35.311084 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:35.324173 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022744a-5a5c-44b5-94b7-81b5a0e24750 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:35.329914 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:35.330602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.330879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.331175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.331891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:35.333488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:35.343891 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1428/2816] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:35.347941 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:35.358346 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c410e68-0ee8-4c1a-8db3-d30088964e95 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:35.363257 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a4c32-aae7-4b00-b178-59fa7c34557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:35.363925 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a4c32-aae7-4b00-b178-59fa7c34557a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.364211 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a4c32-aae7-4b00-b178-59fa7c34557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.364490 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a4c32-aae7-4b00-b178-59fa7c34557a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.365207 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a4c32-aae7-4b00-b178-59fa7c34557a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:35.367172 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a4c32-aae7-4b00-b178-59fa7c34557a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:35.377374 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1389/2817] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:35.381423 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:35.391794 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948840-b878-4a6d-ac83-05820fd538dd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:35.396707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:35.397589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.397871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.398174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] PATH_INFO: `/v3/projects/a03d9ba6ec06469988d61a01396e520b/users/a09f0d946a0b4bc482a823a64acb7051/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.413569 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03d9ba6ec06469988d61a01396e520b, user_id=a09f0d946a0b4bc482a823a64acb7051, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:35.416276 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:35.435583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1429/2818] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:35 2022] PUT /identity/v3/projects/a03d9ba6ec06469988d61a01396e520b/users/a09f0d946a0b4bc482a823a64acb7051/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:35.446617 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90107fe-706c-414d-8463-eab0c3161578 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.446910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90107fe-706c-414d-8463-eab0c3161578 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.447194 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90107fe-706c-414d-8463-eab0c3161578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.476204 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d90107fe-706c-414d-8463-eab0c3161578 None None] MFA Rules not processed for user `a09f0d946a0b4bc482a823a64acb7051`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:35.477426 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d90107fe-706c-414d-8463-eab0c3161578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:35.547812 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1390/2819] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:35.559591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:35.561508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:35.568380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:35.637029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067718-b302-4161-b4b0-956e3a77ab54 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:35.643778 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afb978-df89-468b-98d1-7f9612956c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:35.644456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb978-df89-468b-98d1-7f9612956c64 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:35.644724 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb978-df89-468b-98d1-7f9612956c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:35.644990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb978-df89-468b-98d1-7f9612956c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:35.653598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afb978-df89-468b-98d1-7f9612956c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:35.655219 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afb978-df89-468b-98d1-7f9612956c64 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:35.664193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1430/2820] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:35.937324 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90107fe-706c-414d-8463-eab0c3161578 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:36.002564 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90107fe-706c-414d-8463-eab0c3161578 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:36.007598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:36.008482 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.008771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.009049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] PATH_INFO: `/v3/users/a09f0d946a0b4bc482a823a64acb7051` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.010326 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09f0d946a0b4bc482a823a64acb7051)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:36.012282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:36.064004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09f0d946a0b4bc482a823a64acb7051'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.070802 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09f0d946a0b4bc482a823a64acb7051'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.072553 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:36.081017 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09f0d946a0b4bc482a823a64acb7051'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.100879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09f0d946a0b4bc482a823a64acb7051'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.101674 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09f0d946a0b4bc482a823a64acb7051'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.108429 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1391/2821] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:35 2022] DELETE /identity/v3/users/a09f0d946a0b4bc482a823a64acb7051 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:36.114055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.114572 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.115157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.138944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:36.140313 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:36.206438 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1431/2822] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:36.216378 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:36.217889 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:36.277649 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b98f-79f1-4574-a3d6-653fe578b0be admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:36.281713 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839855c9-1f5f-43dd-9a5b-e4acdb314a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:36.283103 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839855c9-1f5f-43dd-9a5b-e4acdb314a6b service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.283393 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839855c9-1f5f-43dd-9a5b-e4acdb314a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.283677 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839855c9-1f5f-43dd-9a5b-e4acdb314a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.293345 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839855c9-1f5f-43dd-9a5b-e4acdb314a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:36.294841 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839855c9-1f5f-43dd-9a5b-e4acdb314a6b service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:36.304468 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1392/2823] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:36.603093 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:36.604570 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:36.617942 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f0eb-5ad8-46e4-bbf0-ced7427fd65f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:36.624464 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:36.625369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.625650 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.625923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] PATH_INFO: `/v3/projects/a03d9ba6ec06469988d61a01396e520b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.627214 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03d9ba6ec06469988d61a01396e520b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:36.629241 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:36.680061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03d9ba6ec06469988d61a01396e520b', 'request_id': 'req-9357d16a-8f93-4b51-9cb6-e016f593eacd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.686876 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03d9ba6ec06469988d61a01396e520b', 'request_id': 'req-9357d16a-8f93-4b51-9cb6-e016f593eacd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.695580 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03d9ba6ec06469988d61a01396e520b', 'request_id': 'req-9357d16a-8f93-4b51-9cb6-e016f593eacd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.706054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] The token cache is being invalidate because project a03d9ba6ec06469988d61a01396e520b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:36.706371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.706982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9357d16a-8f93-4b51-9cb6-e016f593eacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:36.708533 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1432/2824] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:36 2022] DELETE /identity/v3/projects/a03d9ba6ec06469988d61a01396e520b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:36.713611 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec9b0-605f-496c-909b-f300ae7d1d1b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.714097 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec9b0-605f-496c-909b-f300ae7d1d1b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.714316 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec9b0-605f-496c-909b-f300ae7d1d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.732796 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cefec9b0-605f-496c-909b-f300ae7d1d1b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:36.734002 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cefec9b0-605f-496c-909b-f300ae7d1d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:36.804741 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1393/2825] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:36.814376 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9925-5998-4f6d-b5e6-94a933d8de1b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.814723 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9925-5998-4f6d-b5e6-94a933d8de1b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.815113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9925-5998-4f6d-b5e6-94a933d8de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.839332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6a8d9925-5998-4f6d-b5e6-94a933d8de1b None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:36.840779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a8d9925-5998-4f6d-b5e6-94a933d8de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:36.850299 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1433/2826] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:36.854539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefec9b0-605f-496c-909b-f300ae7d1d1b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:36.864535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefec9b0-605f-496c-909b-f300ae7d1d1b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:36.870282 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:36.870940 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.871220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.871493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.872219 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:36.872523 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:36.874147 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:36.886203 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1394/2827] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:23:36.891399 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d9925-5998-4f6d-b5e6-94a933d8de1b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:36.905828 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d9925-5998-4f6d-b5e6-94a933d8de1b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:36.914908 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:36.915844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:36.916153 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:36.916499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:36.917456 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:36.919545 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:36.923106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:36.950998 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1434/2828] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:36 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:36.955115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:36.965561 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426522b-0b82-4ed8-a747-db62ae1f21b9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.025893 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.026594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.026875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.027164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.027879 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.029825 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.038408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:37.054049 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1395/2829] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:36 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:37.058527 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.069776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3317-d844-4ab2-a5ca-6b49b73fa5e8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.075740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.076407 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.076691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.076964 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.077694 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.079346 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.090222 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1435/2830] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:37.096080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.107371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7feb66-0e66-42d9-8a21-079243991b7e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.112319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12044724-d29b-424c-8ac3-62572fcba369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.112969 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12044724-d29b-424c-8ac3-62572fcba369 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.113258 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12044724-d29b-424c-8ac3-62572fcba369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.113531 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12044724-d29b-424c-8ac3-62572fcba369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.114280 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12044724-d29b-424c-8ac3-62572fcba369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.115868 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12044724-d29b-424c-8ac3-62572fcba369 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.126535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1396/2831] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:37.130773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.140870 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c7ca6-5f06-4d61-b368-3bf5c07d9873 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.145638 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.146547 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.146837 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.147118 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] PATH_INFO: `/v3/projects/6e6ab4fd61a74210a3b32ef7dac40c64/users/b19d52c8fb454c339f14200d49534c9b/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.162410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6ab4fd61a74210a3b32ef7dac40c64, user_id=b19d52c8fb454c339f14200d49534c9b, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.165071 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.181188 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1436/2832] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:37 2022] PUT /identity/v3/projects/6e6ab4fd61a74210a3b32ef7dac40c64/users/b19d52c8fb454c339f14200d49534c9b/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:37.191690 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141467a8-cac1-4fc0-8c04-7748b6d96e96 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.191978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141467a8-cac1-4fc0-8c04-7748b6d96e96 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.192256 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141467a8-cac1-4fc0-8c04-7748b6d96e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.220176 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-141467a8-cac1-4fc0-8c04-7748b6d96e96 None None] MFA Rules not processed for user `b19d52c8fb454c339f14200d49534c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:37.221390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-141467a8-cac1-4fc0-8c04-7748b6d96e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:37.284877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1397/2833] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:37.289647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.359929 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551994-b5df-42c7-b889-e4f07979c0f8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.368209 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.369159 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.369436 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.369736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.370979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.373484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.404113 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1437/2834] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:37 2022] POST /identity/v3/projects => generated 361 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:37.408431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141467a8-cac1-4fc0-8c04-7748b6d96e96 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.419672 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141467a8-cac1-4fc0-8c04-7748b6d96e96 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.483266 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.484294 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.484660 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.485025 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.486142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.488997 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.511479 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1398/2835] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:37 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:37.515671 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.526489 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b415dbe-f8f4-46dd-91e2-43e34e6d76d5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.532758 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.533432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.533760 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.534043 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.534810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.536501 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.548237 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1438/2836] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:37.552549 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.562983 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe122f-7538-4eda-94ec-10a73817ed80 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.568242 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.569137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.569448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.569732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] PATH_INFO: `/v3/projects/b49004e14bfb41a099a2c865a170335d/users/31232e6d01ed48d79d839476c511d9a3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.585737 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49004e14bfb41a099a2c865a170335d, user_id=31232e6d01ed48d79d839476c511d9a3, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.588491 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.604221 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1399/2837] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:37 2022] PUT /identity/v3/projects/b49004e14bfb41a099a2c865a170335d/users/31232e6d01ed48d79d839476c511d9a3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:37.609021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.623854 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67fd36-eec7-4641-809e-d78b21efc595 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.684375 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea66ce-0ed1-49ef-b073-1fae6020f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.685417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea66ce-0ed1-49ef-b073-1fae6020f76a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.685708 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea66ce-0ed1-49ef-b073-1fae6020f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.685989 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea66ce-0ed1-49ef-b073-1fae6020f76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.686793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea66ce-0ed1-49ef-b073-1fae6020f76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.688403 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea66ce-0ed1-49ef-b073-1fae6020f76a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.698598 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1439/2838] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:37.703671 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.714728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4e4b7-d1b9-44a6-8248-f648167d33e8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.720130 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.721001 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.721289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.721569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] PATH_INFO: `/v3/projects/b49004e14bfb41a099a2c865a170335d/users/31232e6d01ed48d79d839476c511d9a3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.723876 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49004e14bfb41a099a2c865a170335d, user_id=31232e6d01ed48d79d839476c511d9a3, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.726594 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.738729 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1400/2839] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:37 2022] PUT /identity/v3/projects/b49004e14bfb41a099a2c865a170335d/users/31232e6d01ed48d79d839476c511d9a3/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:37.756615 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd874-8ab1-43c0-84c4-8faa60a9cd6c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.757194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd874-8ab1-43c0-84c4-8faa60a9cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.757497 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd874-8ab1-43c0-84c4-8faa60a9cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.787198 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-27cdd874-8ab1-43c0-84c4-8faa60a9cd6c None None] MFA Rules not processed for user `31232e6d01ed48d79d839476c511d9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:37.788462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27cdd874-8ab1-43c0-84c4-8faa60a9cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:37.797943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:37.862927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1440/2840] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:37.875131 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:37.877167 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:37.905391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:37.944892 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa41ae-d254-48ff-9f1c-0af9946e442f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:37.949439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:37.950250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:37.950540 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:37.950815 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:37.960783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:37.962285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:37.972453 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1401/2841] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:37 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:38.046734 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd874-8ab1-43c0-84c4-8faa60a9cd6c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:38.057404 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd874-8ab1-43c0-84c4-8faa60a9cd6c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:38.062145 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3366b-814f-445a-8927-4d25a3c55cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:38.062804 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3366b-814f-445a-8927-4d25a3c55cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:38.063088 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3366b-814f-445a-8927-4d25a3c55cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:38.063363 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3366b-814f-445a-8927-4d25a3c55cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:38.125281 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3366b-814f-445a-8927-4d25a3c55cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:38.126697 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3366b-814f-445a-8927-4d25a3c55cd1 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:38.136148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1441/2842] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:47.968041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=15 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:48.131957 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=53 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:48.526292 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:48.596269 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4144-c477-4a71-87ed-63c3ea4db66a service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:48.602037 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:48.602958 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.603245 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.603530 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] PATH_INFO: `/v3/users/b19d52c8fb454c339f14200d49534c9b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.605038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19d52c8fb454c339f14200d49534c9b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:48.607024 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:48.660586 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19d52c8fb454c339f14200d49534c9b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.668715 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19d52c8fb454c339f14200d49534c9b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.678832 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19d52c8fb454c339f14200d49534c9b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.694052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19d52c8fb454c339f14200d49534c9b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.694906 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19d52c8fb454c339f14200d49534c9b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.701366 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1402/2843] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:48 2022] DELETE /identity/v3/users/b19d52c8fb454c339f14200d49534c9b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:48.706599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.706896 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.707175 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.725706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:48.726968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:48.789627 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1442/2844] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:48.805197 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:48.807867 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:48.883978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6193f59-af39-4b2f-ba54-60fe0fbc763c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:48.887947 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:48.888601 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.888895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.889174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.898863 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:48.900312 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:48.909952 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1403/2845] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:49.192158 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.194366 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:49.207993 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817401-8a5b-4657-b255-9997ac133483 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.213029 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.213869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.214218 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.214509 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] PATH_INFO: `/v3/projects/6e6ab4fd61a74210a3b32ef7dac40c64` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.215672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6ab4fd61a74210a3b32ef7dac40c64)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.217594 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.265488 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6ab4fd61a74210a3b32ef7dac40c64', 'request_id': 'req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.272052 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6ab4fd61a74210a3b32ef7dac40c64', 'request_id': 'req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.281815 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6ab4fd61a74210a3b32ef7dac40c64', 'request_id': 'req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.292484 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] The token cache is being invalidate because project 6e6ab4fd61a74210a3b32ef7dac40c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:49.292776 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.293417 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.295015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1443/2846] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:49 2022] DELETE /identity/v3/projects/6e6ab4fd61a74210a3b32ef7dac40c64 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:49.299109 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.309210 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eca876-b70c-4bb5-81fe-4fbca5a0b50d service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.329068 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:49.371973 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.372866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.373151 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.373430 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] PATH_INFO: `/v3/users/31232e6d01ed48d79d839476c511d9a3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.374705 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31232e6d01ed48d79d839476c511d9a3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.376669 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.437652 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31232e6d01ed48d79d839476c511d9a3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.445190 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31232e6d01ed48d79d839476c511d9a3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.455254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31232e6d01ed48d79d839476c511d9a3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.468082 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31232e6d01ed48d79d839476c511d9a3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.468734 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4f493f65-4fbf-4054-98fd-322cd776b6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31232e6d01ed48d79d839476c511d9a3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.474800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1404/2847] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:49 2022] DELETE /identity/v3/users/31232e6d01ed48d79d839476c511d9a3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:49.764072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.765601 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:49.779362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f2c9b-cb8e-497d-984b-d2a8ac23ff66 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.837532 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.838454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.838740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.839015 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] PATH_INFO: `/v3/projects/b49004e14bfb41a099a2c865a170335d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.840227 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49004e14bfb41a099a2c865a170335d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.842191 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.875707 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:49.898962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49004e14bfb41a099a2c865a170335d', 'request_id': 'req-34e732b0-22a9-4c1e-afd1-8ba435563102'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.905174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49004e14bfb41a099a2c865a170335d', 'request_id': 'req-34e732b0-22a9-4c1e-afd1-8ba435563102'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.914157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49004e14bfb41a099a2c865a170335d', 'request_id': 'req-34e732b0-22a9-4c1e-afd1-8ba435563102'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.924392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] The token cache is being invalidate because project b49004e14bfb41a099a2c865a170335d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:49.924674 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.925296 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-34e732b0-22a9-4c1e-afd1-8ba435563102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.926885 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1444/2848] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:49 2022] DELETE /identity/v3/projects/b49004e14bfb41a099a2c865a170335d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:49.933119 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95abe5-c09a-4f94-abbc-9bbc2bfe39f6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.933415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95abe5-c09a-4f94-abbc-9bbc2bfe39f6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.933693 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95abe5-c09a-4f94-abbc-9bbc2bfe39f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.952882 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ae95abe5-c09a-4f94-abbc-9bbc2bfe39f6 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:49.954043 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ae95abe5-c09a-4f94-abbc-9bbc2bfe39f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.017106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1405/2849] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:50.025657 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823725d-5a13-46fd-a03c-4f08e5699fb9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.025952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823725d-5a13-46fd-a03c-4f08e5699fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.026278 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823725d-5a13-46fd-a03c-4f08e5699fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.046432 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7823725d-5a13-46fd-a03c-4f08e5699fb9 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:50.047675 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7823725d-5a13-46fd-a03c-4f08e5699fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.057305 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1445/2850] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:50.061928 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95abe5-c09a-4f94-abbc-9bbc2bfe39f6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.073101 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95abe5-c09a-4f94-abbc-9bbc2bfe39f6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.078271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.078971 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.079250 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.079528 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.080252 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:50.080559 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.082198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.095376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1406/2851] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:23:50.099932 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823725d-5a13-46fd-a03c-4f08e5699fb9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.109552 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823725d-5a13-46fd-a03c-4f08e5699fb9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.115955 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.117142 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.117435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.117713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.118452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.120402 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.150433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1446/2852] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:50.156904 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.169914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c227-df67-408e-a4fb-e4aa18e90cfb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.197774 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:50.237198 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.237877 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.238186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.238476 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.239231 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.241633 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.263846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1407/2853] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:50.268265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.279192 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90d94-e447-469e-b11d-4aa2a444f526 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.284820 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.285493 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.285777 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.286054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.286824 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.288529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.299344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1447/2854] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:50.303371 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.313991 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77fbb-0355-45d1-a794-c0666d892e9a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.319619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3dfed8-fccc-47c0-8993-d698cc4a0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.320293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dfed8-fccc-47c0-8993-d698cc4a0a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.320584 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dfed8-fccc-47c0-8993-d698cc4a0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.320861 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dfed8-fccc-47c0-8993-d698cc4a0a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.321598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3dfed8-fccc-47c0-8993-d698cc4a0a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.323255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3dfed8-fccc-47c0-8993-d698cc4a0a77 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.333750 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1408/2855] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:50.338582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.349612 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055d6c-eab7-49a2-bb3c-a3ded6283b6a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.355519 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.356419 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.356698 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.356962 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] PATH_INFO: `/v3/projects/d5f901d8296a4075a06edb88254fd64c/users/bbc528bdcebc434896efcf8bfd9f4f02/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.372635 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f901d8296a4075a06edb88254fd64c, user_id=bbc528bdcebc434896efcf8bfd9f4f02, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.375392 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.390328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1448/2856] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:50 2022] PUT /identity/v3/projects/d5f901d8296a4075a06edb88254fd64c/users/bbc528bdcebc434896efcf8bfd9f4f02/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:50.395539 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e483e92-b9f7-42b1-a3e6-8d47a98243e2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.395872 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e483e92-b9f7-42b1-a3e6-8d47a98243e2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.396205 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e483e92-b9f7-42b1-a3e6-8d47a98243e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.415328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2e483e92-b9f7-42b1-a3e6-8d47a98243e2 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:50.417412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2e483e92-b9f7-42b1-a3e6-8d47a98243e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.492588 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1409/2857] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:50.502844 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.504860 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.564944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ab602-bc6f-4a5e-8134-1f21c1d01a2d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.569023 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.569865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.570169 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.570452 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.581014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.582517 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.592453 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1449/2858] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:51.534645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c0e9-3493-4633-849f-413e804eb69f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.535492 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c0e9-3493-4633-849f-413e804eb69f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.535775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c0e9-3493-4633-849f-413e804eb69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.565964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a478c0e9-3493-4633-849f-413e804eb69f None None] MFA Rules not processed for user `bbc528bdcebc434896efcf8bfd9f4f02`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:51.567372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a478c0e9-3493-4633-849f-413e804eb69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.637328 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1410/2859] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:51.648193 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.650583 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.711706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c5e6d-8e46-445d-91ec-d0c9632e7d31 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.715409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdafe8-c818-4768-9f97-e3c4b5429e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.716068 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdafe8-c818-4768-9f97-e3c4b5429e35 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.716355 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdafe8-c818-4768-9f97-e3c4b5429e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.716633 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdafe8-c818-4768-9f97-e3c4b5429e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.722922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:51.725458 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdafe8-c818-4768-9f97-e3c4b5429e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.727467 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdafe8-c818-4768-9f97-e3c4b5429e35 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.737496 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1450/2860] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:53.144524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adebb-8e08-4ff5-83ee-e0fc6e1e94ad None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:53.145052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adebb-8e08-4ff5-83ee-e0fc6e1e94ad None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:53.145052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adebb-8e08-4ff5-83ee-e0fc6e1e94ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:53.170005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-941adebb-8e08-4ff5-83ee-e0fc6e1e94ad None None] MFA Rules not processed for user `bbc528bdcebc434896efcf8bfd9f4f02`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:53.171255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-941adebb-8e08-4ff5-83ee-e0fc6e1e94ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:53.179932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1411/2861] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:23:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:01.740483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:03.163635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:12.720871 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faa640-4774-492b-94a6-462ad15513e4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:12.721447 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faa640-4774-492b-94a6-462ad15513e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:12.721556 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faa640-4774-492b-94a6-462ad15513e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:12.740457 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-05faa640-4774-492b-94a6-462ad15513e4 None None] MFA Rules not processed for user `bbc528bdcebc434896efcf8bfd9f4f02`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:12.742011 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-05faa640-4774-492b-94a6-462ad15513e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:12.749660 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1451/2862] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:12.997388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941adebb-8e08-4ff5-83ee-e0fc6e1e94ad None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.008746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941adebb-8e08-4ff5-83ee-e0fc6e1e94ad None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.013285 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.014140 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.014450 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.014732 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.016758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.026675 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.028115 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.036331 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1412/2863] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:22.734893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:23.032800 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:32.267922 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efefb4-05e7-47ac-98a8-7f9ebfa6e449 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:32.268410 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efefb4-05e7-47ac-98a8-7f9ebfa6e449 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:32.268508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efefb4-05e7-47ac-98a8-7f9ebfa6e449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:32.339923 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b9efefb4-05e7-47ac-98a8-7f9ebfa6e449 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:32.341157 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b9efefb4-05e7-47ac-98a8-7f9ebfa6e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:32.431610 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1452/2864] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:24:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:32.483529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:32.485174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:32.640220 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d2bee-b3f0-49ce-a424-12337dad9575 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:32.646334 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:32.646999 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:32.647284 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:32.647560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:32.656895 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:32.658568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:32.666976 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1413/2865] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:24:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:24:42.428836 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=57 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:42.664050 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=63 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:47.206505 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:47.207001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:47.207001 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:47.225853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:47.227603 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:47.235332 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1453/2866] 10.222.0.58 () {58 vars in 967 bytes} [Fri Jun 3 13:24:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:47.247910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:47.259350 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531697d-ad74-4515-8728-3c404c04a272 service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:47.265673 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:47.266364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:47.266645 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:47.266914 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:47.275709 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:47.277307 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:47.285412 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1414/2867] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:24:49.511816 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:49.513557 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:49.572837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:49.590795 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e64cf-a9bf-4300-a42c-a83ce19f878d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:49.596677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:49.597491 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:49.597600 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:49.597921 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:49.599713 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:49.605896 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d48910-4fc5-45ca-94a5-6d870841aa25 service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:49.610771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:49.611721 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:49.612072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:49.612352 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] PATH_INFO: `/v3/users/bbc528bdcebc434896efcf8bfd9f4f02` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:49.612705 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:49.613537 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc528bdcebc434896efcf8bfd9f4f02)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:49.614341 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:49.615466 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:49.625371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1454/2868] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:49.670362 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc528bdcebc434896efcf8bfd9f4f02'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:49.678932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc528bdcebc434896efcf8bfd9f4f02'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:49.688382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc528bdcebc434896efcf8bfd9f4f02'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:49.701095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc528bdcebc434896efcf8bfd9f4f02'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:49.701772 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d18030eb-76a9-4cec-85a0-bb44cf62e81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc528bdcebc434896efcf8bfd9f4f02'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:49.708558 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1415/2869] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:49 2022] DELETE /identity/v3/users/bbc528bdcebc434896efcf8bfd9f4f02 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:49.902463 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:49.915319 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103789-8dc2-4531-8f81-01734cb996ce service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:49.973887 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:49.974759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:49.975069 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:49.975349 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] PATH_INFO: `/v3/projects/d5f901d8296a4075a06edb88254fd64c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:49.976524 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f901d8296a4075a06edb88254fd64c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:49.978475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.029506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f901d8296a4075a06edb88254fd64c', 'request_id': 'req-6879d5e6-a486-411a-9b6e-f5d1a308cab5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:50.035544 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f901d8296a4075a06edb88254fd64c', 'request_id': 'req-6879d5e6-a486-411a-9b6e-f5d1a308cab5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:50.044098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f901d8296a4075a06edb88254fd64c', 'request_id': 'req-6879d5e6-a486-411a-9b6e-f5d1a308cab5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:50.068920 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] The token cache is being invalidate because project d5f901d8296a4075a06edb88254fd64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:50.069135 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:50.069893 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6879d5e6-a486-411a-9b6e-f5d1a308cab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:50.071617 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1455/2870] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:49 2022] DELETE /identity/v3/projects/d5f901d8296a4075a06edb88254fd64c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:50.079271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e688c-ecc1-4726-bbd8-00cb27ce53b8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.079744 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e688c-ecc1-4726-bbd8-00cb27ce53b8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.080080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e688c-ecc1-4726-bbd8-00cb27ce53b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.102471 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-724e688c-ecc1-4726-bbd8-00cb27ce53b8 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:50.103728 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-724e688c-ecc1-4726-bbd8-00cb27ce53b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:50.166760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1416/2871] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:50.175540 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbf30-3568-4ff3-b930-93052232d98f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.175830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbf30-3568-4ff3-b930-93052232d98f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.176114 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbf30-3568-4ff3-b930-93052232d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.182725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:50.198506 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2e2dbf30-3568-4ff3-b930-93052232d98f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:50.199946 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2e2dbf30-3568-4ff3-b930-93052232d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:50.210855 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1456/2872] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:50.215452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e688c-ecc1-4726-bbd8-00cb27ce53b8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:50.225920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e688c-ecc1-4726-bbd8-00cb27ce53b8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:50.231422 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:50.232086 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.232364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.232635 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.233359 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:50.233668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:50.235311 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.248004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1417/2873] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:24:50.252462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dbf30-3568-4ff3-b930-93052232d98f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:50.262315 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dbf30-3568-4ff3-b930-93052232d98f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:50.267576 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:50.268249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.268535 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.268817 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.269523 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:50.271473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.301522 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1457/2874] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:50.304961 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:50.316014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf05f7-f3dd-4c9d-832d-87d52702d754 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:50.346634 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:50.375760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:50.376431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.376711 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.376987 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.377663 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:50.379691 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.403688 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1418/2875] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:50 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:50.408089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:50.419985 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b787-0b78-4240-8be9-fb09c3872b97 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:50.425240 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:50.425899 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.426223 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.426500 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.427220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:50.428830 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.440017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1458/2876] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:50.444075 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:50.454787 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c45f7-d09a-4176-aeeb-d7648ac9e2ea admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:50.460437 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea908a-8179-4252-b3a5-67308901cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:50.461107 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea908a-8179-4252-b3a5-67308901cdbf admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.461388 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea908a-8179-4252-b3a5-67308901cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.461666 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea908a-8179-4252-b3a5-67308901cdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.462408 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea908a-8179-4252-b3a5-67308901cdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:50.464052 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea908a-8179-4252-b3a5-67308901cdbf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.474524 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1419/2877] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:50.478582 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:50.489329 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa3f0-26f3-4c33-a610-cd66357321cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:50.494770 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:50.495731 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.496480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.496857 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] PATH_INFO: `/v3/projects/e19046007a41440fb351a8b44c30c4f2/users/6c829393baab4e1a827604a57944e204/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.512620 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19046007a41440fb351a8b44c30c4f2, user_id=6c829393baab4e1a827604a57944e204, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:50.515348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.533808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1459/2878] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:50 2022] PUT /identity/v3/projects/e19046007a41440fb351a8b44c30c4f2/users/6c829393baab4e1a827604a57944e204/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:50.544839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3fe9e-ad46-4fb4-ae49-b82d3a4eb60b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.544839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3fe9e-ad46-4fb4-ae49-b82d3a4eb60b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.545080 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3fe9e-ad46-4fb4-ae49-b82d3a4eb60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.573842 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-eae3fe9e-ad46-4fb4-ae49-b82d3a4eb60b None None] MFA Rules not processed for user `6c829393baab4e1a827604a57944e204`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:50.575229 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-eae3fe9e-ad46-4fb4-ae49-b82d3a4eb60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:50.646535 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1420/2879] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:50.659499 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:50.661483 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:50.720395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9f6b9-18f3-4126-b53b-9e5c2c27396a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:50.724867 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ea8e8f73ad4862a22ca7ce2b461740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:50.725526 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:50.725810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:50.726091 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:50.737100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:50.739297 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:50.750003 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1460/2880] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:52.115979 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b8b77-22f7-46e1-b5f2-981dc3deccd5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:52.116521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b8b77-22f7-46e1-b5f2-981dc3deccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:52.116521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b8b77-22f7-46e1-b5f2-981dc3deccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:52.135309 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-576b8b77-22f7-46e1-b5f2-981dc3deccd5 None None] MFA Rules not processed for user `6c829393baab4e1a827604a57944e204`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:52.136516 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-576b8b77-22f7-46e1-b5f2-981dc3deccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:52.144463 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1421/2881] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:54.446060 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:54.447744 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:54.532380 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c01bed-a0d3-48d6-9d87-4aaa70a42dbc service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:54.536290 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:54.537010 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:54.537174 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:54.537451 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:54.539624 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:54.550354 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:54.551787 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:54.559808 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1461/2882] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:02.129763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=55,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:04.556215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:05.883783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c66d1-9bc0-4eaf-8404-15f375323916 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:05.884265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c66d1-9bc0-4eaf-8404-15f375323916 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:05.884364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c66d1-9bc0-4eaf-8404-15f375323916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:05.903187 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a15c66d1-9bc0-4eaf-8404-15f375323916 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:05.904418 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a15c66d1-9bc0-4eaf-8404-15f375323916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:05.968517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1422/2883] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:05.980670 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:05.982148 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:06.054103 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4de8-9dfa-426b-8590-ca28ebd814fb service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:06.061012 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:06.061851 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:06.062160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:06.062546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:06.075691 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:06.077516 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:06.085649 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1462/2884] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:06.620920 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af368a-3549-43bf-bfcc-e160a6d888ad None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:06.621403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af368a-3549-43bf-bfcc-e160a6d888ad None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:06.621927 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af368a-3549-43bf-bfcc-e160a6d888ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:06.647184 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a9af368a-3549-43bf-bfcc-e160a6d888ad None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:06.648391 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a9af368a-3549-43bf-bfcc-e160a6d888ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:06.656510 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1423/2885] 10.222.0.58 () {58 vars in 967 bytes} [Fri Jun 3 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:06.668976 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:06.680656 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82465cd4-0355-4d1c-b35f-cb2fdb1ae93e service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:06.686686 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:06.687475 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:06.687762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:06.688042 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:06.696365 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:06.697958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:06.706472 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1463/2886] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:06.905325 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13943776-b550-4b62-bd59-d64ca1a1b1e3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:06.905847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13943776-b550-4b62-bd59-d64ca1a1b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:06.905964 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13943776-b550-4b62-bd59-d64ca1a1b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:06.924286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-13943776-b550-4b62-bd59-d64ca1a1b1e3 None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:06.925517 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-13943776-b550-4b62-bd59-d64ca1a1b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:06.933514 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1424/2887] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Jun 3 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:06.946408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:06.960473 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12bf11-16f7-436f-ba47-ae378e6518d9 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:06.966338 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:06.966979 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:06.967265 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:06.967577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:06.976872 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:06.978546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:06.987020 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1464/2888] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:07.319563 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66242b04-b3b7-4b0f-87ef-2cf96bd59a8d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:07.319854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66242b04-b3b7-4b0f-87ef-2cf96bd59a8d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:07.320133 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66242b04-b3b7-4b0f-87ef-2cf96bd59a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:07.337839 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-66242b04-b3b7-4b0f-87ef-2cf96bd59a8d None None] MFA Rules not processed for user `f7c40f2412c44324a20912e7564311ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:07.339055 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-66242b04-b3b7-4b0f-87ef-2cf96bd59a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:07.346425 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1425/2889] 10.222.0.58 () {58 vars in 967 bytes} [Fri Jun 3 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:07.358558 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:07.369546 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52199ee-5773-4c0c-b686-b318d06ca7c5 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:07.375990 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63f4a0-8e44-427b-9fb0-92d3f0de7fcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '770bb4d411374e3daddba2cdf48c3c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:07.376636 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63f4a0-8e44-427b-9fb0-92d3f0de7fcb service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:07.376927 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63f4a0-8e44-427b-9fb0-92d3f0de7fcb service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:07.377207 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63f4a0-8e44-427b-9fb0-92d3f0de7fcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:07.386080 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63f4a0-8e44-427b-9fb0-92d3f0de7fcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:07.387717 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63f4a0-8e44-427b-9fb0-92d3f0de7fcb service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:07.396382 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1465/2890] 10.222.0.58 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:09.555746 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66242b04-b3b7-4b0f-87ef-2cf96bd59a8d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:09.623627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66242b04-b3b7-4b0f-87ef-2cf96bd59a8d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:09.629186 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:09.630077 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:09.630381 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:09.630654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] PATH_INFO: `/v3/users/6c829393baab4e1a827604a57944e204` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:09.631998 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c829393baab4e1a827604a57944e204)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:09.633978 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:09.684681 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c829393baab4e1a827604a57944e204'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:09.691703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c829393baab4e1a827604a57944e204'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:09.700168 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c829393baab4e1a827604a57944e204'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:09.712170 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c829393baab4e1a827604a57944e204'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:09.712870 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c829393baab4e1a827604a57944e204'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:09.718760 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1426/2891] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:25:09 2022] DELETE /identity/v3/users/6c829393baab4e1a827604a57944e204 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:09.723788 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:09.724277 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:09.724369 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:09.742666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:09.743869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:09.809327 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1466/2892] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:09.819069 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:09.820739 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:09.828018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:09.881570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f065f4-b4f2-4418-96c6-d1716ad365bc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:09.885591 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9822a-bd8d-4c3d-96a4-b92efa999d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:09.886286 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9822a-bd8d-4c3d-96a4-b92efa999d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:09.886560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9822a-bd8d-4c3d-96a4-b92efa999d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:09.886853 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9822a-bd8d-4c3d-96a4-b92efa999d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:09.896640 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9822a-bd8d-4c3d-96a4-b92efa999d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:09.898085 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9822a-bd8d-4c3d-96a4-b92efa999d1c service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:09.907775 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1427/2893] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:10.091736 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.094249 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:10.112933 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47695b-64ae-47e1-97bf-cab51c3cbd7f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.118437 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.119304 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.119599 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.119852 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] PATH_INFO: `/v3/projects/e19046007a41440fb351a8b44c30c4f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.121085 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19046007a41440fb351a8b44c30c4f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.123184 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.170367 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:10.173625 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19046007a41440fb351a8b44c30c4f2', 'request_id': 'req-7fd60e1a-8989-4372-9cd2-e9026cb4b179'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:10.181658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19046007a41440fb351a8b44c30c4f2', 'request_id': 'req-7fd60e1a-8989-4372-9cd2-e9026cb4b179'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:10.191101 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19046007a41440fb351a8b44c30c4f2', 'request_id': 'req-7fd60e1a-8989-4372-9cd2-e9026cb4b179'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:10.201409 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] The token cache is being invalidate because project e19046007a41440fb351a8b44c30c4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:25:10.201699 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:10.202476 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7fd60e1a-8989-4372-9cd2-e9026cb4b179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:10.203988 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1467/2894] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:25:10 2022] DELETE /identity/v3/projects/e19046007a41440fb351a8b44c30c4f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:10.209271 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b902e6-68b4-43a9-ad44-bee50c567114 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.209569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b902e6-68b4-43a9-ad44-bee50c567114 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.209874 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b902e6-68b4-43a9-ad44-bee50c567114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.228614 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-99b902e6-68b4-43a9-ad44-bee50c567114 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:10.229845 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-99b902e6-68b4-43a9-ad44-bee50c567114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:10.292620 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1428/2895] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:25:10.300681 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca08a4-a6dc-40f0-9a5b-e0e4a2436d98 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.300971 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca08a4-a6dc-40f0-9a5b-e0e4a2436d98 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.301247 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca08a4-a6dc-40f0-9a5b-e0e4a2436d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.320014 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-acca08a4-a6dc-40f0-9a5b-e0e4a2436d98 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:10.321272 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-acca08a4-a6dc-40f0-9a5b-e0e4a2436d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:10.329340 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1468/2896] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:10.333758 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b902e6-68b4-43a9-ad44-bee50c567114 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.343442 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b902e6-68b4-43a9-ad44-bee50c567114 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.348095 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.348759 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.349041 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.349321 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.350047 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:25:10.350397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.352004 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.363439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1429/2897] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Jun 3 13:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:25:10.368058 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca08a4-a6dc-40f0-9a5b-e0e4a2436d98 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.377853 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca08a4-a6dc-40f0-9a5b-e0e4a2436d98 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.383433 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.384089 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.384371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.384647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.385951 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.388647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.419037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1469/2898] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:25:10 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:25:10.423265 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.433624 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2fba-0546-4824-b5a2-f3b4a4c6adaf admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.502846 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.503568 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.503854 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.504135 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.504833 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.507013 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.530942 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1430/2899] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:25:10 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:25:10.535205 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.547036 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b069-dfcb-436c-b4c2-daec5680f624 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.552397 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.553074 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.553356 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.553647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.554396 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.556028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.567215 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1470/2900] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:25:10.572067 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.583089 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b051ae-8b0b-460c-9d6b-f6a7684a522b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.588511 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8ae9c-0907-4bb8-a766-23d0ae6c5cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.589117 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8ae9c-0907-4bb8-a766-23d0ae6c5cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.589404 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8ae9c-0907-4bb8-a766-23d0ae6c5cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.589684 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8ae9c-0907-4bb8-a766-23d0ae6c5cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.590448 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8ae9c-0907-4bb8-a766-23d0ae6c5cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.592124 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8ae9c-0907-4bb8-a766-23d0ae6c5cbf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.602765 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1431/2901] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:25:10.607004 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.617715 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65fa6d-df5b-4789-89a6-8cbaef0f2583 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.623879 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.624775 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.625054 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.625326 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] PATH_INFO: `/v3/projects/eb24e89507a54ec080cbb570f57ae7df/users/9294e649dc51425ba978e70f4635ddb6/roles/de38664d376f45f6a446103b7f17e7b3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.641061 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb24e89507a54ec080cbb570f57ae7df, user_id=9294e649dc51425ba978e70f4635ddb6, role_id=de38664d376f45f6a446103b7f17e7b3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.643725 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.659865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1471/2902] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:25:10 2022] PUT /identity/v3/projects/eb24e89507a54ec080cbb570f57ae7df/users/9294e649dc51425ba978e70f4635ddb6/roles/de38664d376f45f6a446103b7f17e7b3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:10.665226 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf389768-eec6-4103-84dd-d2b7b3a9e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.665521 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf389768-eec6-4103-84dd-d2b7b3a9e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.665810 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf389768-eec6-4103-84dd-d2b7b3a9e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.684751 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bf389768-eec6-4103-84dd-d2b7b3a9e3d0 None None] MFA Rules not processed for user `0996f80baf904a69852b0b6c8fb6bc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:10.685968 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bf389768-eec6-4103-84dd-d2b7b3a9e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:10.695397 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:10.751154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1432/2903] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:10.761065 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:10.762994 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:10.826878 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c729f-ddb4-447f-9bab-160cee13f485 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:10.831809 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:10.832474 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:10.832759 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:10.833056 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:10.842821 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:10.844271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:10.854026 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1472/2904] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:15.084493 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1913-78dd-4b50-bed5-54d49608b1ce None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:15.085423 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1913-78dd-4b50-bed5-54d49608b1ce None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:15.085696 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1913-78dd-4b50-bed5-54d49608b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:15.120885 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-793e1913-78dd-4b50-bed5-54d49608b1ce None None] MFA Rules not processed for user `9294e649dc51425ba978e70f4635ddb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:15.122293 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-793e1913-78dd-4b50-bed5-54d49608b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:15.197106 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1433/2905] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:15.201577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:15.229195 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4699c-1482-4d6c-aa6d-732e015ffd36 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:15.246197 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:15.247220 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:15.247520 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:15.247810 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:15.249395 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:15.251711 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:15.282275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1473/2906] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Jun 3 13:25:15 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:25:15.286500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e1913-78dd-4b50-bed5-54d49608b1ce None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:15.298146 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e1913-78dd-4b50-bed5-54d49608b1ce None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:15.363072 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:15.363762 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:15.364044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:15.364319 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:15.365014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:15.367005 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:15.390748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1434/2907] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Jun 3 13:25:15 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:25:15.396331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:15.407333 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d0b25-53de-4304-a09d-26fa70c95645 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:15.412931 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:15.413658 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:15.413943 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:15.414258 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:15.414992 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:15.416677 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:15.432312 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1474/2908] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:25:15.436501 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:15.447685 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588451e-21b2-4f6d-9a92-9ea6a00e26b7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:15.452428 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:15.453400 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:15.453648 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:15.453924 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] PATH_INFO: `/v3/projects/ee6a2fa636184e08a55bc498965d5382/users/3e9f42e02f7f40ea8ac850207cba47f2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:15.471439 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6a2fa636184e08a55bc498965d5382, user_id=3e9f42e02f7f40ea8ac850207cba47f2, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:15.473989 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:15.490607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1435/2909] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:25:15 2022] PUT /identity/v3/projects/ee6a2fa636184e08a55bc498965d5382/users/3e9f42e02f7f40ea8ac850207cba47f2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:15.495096 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:15.506639 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bc70d-3827-4a33-8a7a-953a49b8c96c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:15.549602 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:15.570762 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bb785-f97a-4c92-b428-3189eedb5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:15.571605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bb785-f97a-4c92-b428-3189eedb5b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:15.572041 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bb785-f97a-4c92-b428-3189eedb5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:15.572321 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bb785-f97a-4c92-b428-3189eedb5b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:15.573102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bb785-f97a-4c92-b428-3189eedb5b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:15.574773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bb785-f97a-4c92-b428-3189eedb5b80 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:15.585948 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1475/2910] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Jun 3 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:25:15.590038 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:15.602662 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2869a-67eb-4877-b9df-17fd80d335c8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:15.607703 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:15.608621 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:15.608907 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:15.609182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] PATH_INFO: `/v3/projects/ee6a2fa636184e08a55bc498965d5382/users/3e9f42e02f7f40ea8ac850207cba47f2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:15.611607 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6a2fa636184e08a55bc498965d5382, user_id=3e9f42e02f7f40ea8ac850207cba47f2, role_id=94bfd3cf958f4c5e8aefebf7cf0ddedb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:15.614364 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:15.618390 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:15.628137 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1436/2911] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Jun 3 13:25:15 2022] PUT /identity/v3/projects/ee6a2fa636184e08a55bc498965d5382/users/3e9f42e02f7f40ea8ac850207cba47f2/roles/94bfd3cf958f4c5e8aefebf7cf0ddedb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:19.990672 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099845-456e-4ab0-ae6e-6cad6df96a6d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:19.991172 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099845-456e-4ab0-ae6e-6cad6df96a6d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:19.991294 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099845-456e-4ab0-ae6e-6cad6df96a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:20.020793 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d9099845-456e-4ab0-ae6e-6cad6df96a6d None None] MFA Rules not processed for user `3e9f42e02f7f40ea8ac850207cba47f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:20.022328 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d9099845-456e-4ab0-ae6e-6cad6df96a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:20.091420 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1476/2912] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:20.108894 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:20.111289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:20.191290 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678a002-366d-4a6c-b268-12167e359bd4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:20.199237 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:20.199891 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:20.200255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:20.200473 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:20.262136 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:20.263816 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:20.273922 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1437/2913] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:21.371362 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:21.371865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:21.371972 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:21.390865 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] MFA Rules not processed for user `9294e649dc51425ba978e70f4635ddb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:21.392119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:21.399371 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1477/2914] 10.222.0.58 () {58 vars in 957 bytes} [Fri Jun 3 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:25:30.269264 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=58 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:31.384754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=48 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:59.430403 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:59.499154 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbf269-ee86-4855-a136-9dc71f82f1cc service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:59.503519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:59.504254 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:59.504542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:59.504864 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:59.514827 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:59.516279 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:59.526145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1438/2915] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:09.521934 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=26 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:40.172021 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:40.173706 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:40.270059 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9e7e7-996e-47af-a3a0-5a82eede2cb4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:40.276372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:40.277078 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:40.277344 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:40.277647 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:40.279631 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:40.291984 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:40.293577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:40.303843 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1478/2916] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:50.299589 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=41 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.497483 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:15.499056 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:15.511500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff532933-bbe1-41f1-a95e-f5234c33cfaf service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:15.515420 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:15.516062 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:15.516349 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:15.516619 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:15.518415 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:15.561084 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:15.562570 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:15.583145 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1439/2917] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:16.771129 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:16.781323 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2db3f-1273-4dd0-b6ec-6fe1800dcaf8 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:16.785324 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:16.785967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:16.786283 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:16.786571 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:16.788529 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:16.802825 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:16.804194 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:16.815480 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1479/2918] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:25.580447 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=18 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:26.810912 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:33.574044 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:33.583144 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a253-350d-4da9-a501-16c162709b15 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:33.587142 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:33.587783 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:33.588061 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:33.588336 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:33.590464 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:33.600417 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:33.601837 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:33.610240 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1440/2919] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:33.722641 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:33.732291 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1698-1c28-4ac5-8e19-d1d177ee5b13 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:33.736202 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:33.736834 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:33.737119 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:33.737393 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:33.739271 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:33.750485 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:33.751945 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:33.760518 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1480/2920] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:33.846306 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:33.855748 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aba29-21a7-4ec1-8130-4011484d67db service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:33.859726 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:33.860431 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:33.860654 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:33.860932 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:33.862957 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:33.877289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:33.878795 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:33.889875 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1441/2921] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:33.950037 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:33.951823 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:33.971666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98262-a8c4-4b6b-a55f-66233a97d25e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:33.981471 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:33.982137 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:33.982425 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:33.982696 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:33.984869 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:33.997462 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:33.999100 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:34.009242 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1481/2922] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:37.185543 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:37.197814 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69286c-21a7-4ecc-92eb-accd0b9d49e8 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:37.204335 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:37.204994 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:37.205278 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:37.205556 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:37.207763 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:37.231786 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:37.233452 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:37.259702 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1442/2923] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:44.005160 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:47.240529 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=18 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:12.392210 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:12.405958 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499908a2-b2e2-46c7-96fc-1dae5c3f587b service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:12.412408 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8948febd509a4edca08572764acfdcba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:12.413072 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:12.413330 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:12.413637 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:12.415606 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:12.429372 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:12.431025 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:12.442772 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1482/2924] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:12.510376 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:12.523809 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0d1c7-7624-40b1-8d8d-4f051bd27e3e service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:12.529113 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:12.529777 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:12.530372 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:12.530794 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:12.532937 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:12.551843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:12.553382 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:12.563164 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1443/2925] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:16.307098 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:16.317454 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004346-d880-47df-b130-b7b30ba7f862 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:16.321614 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa3a98382cd4b04bb384bbc2ab3a598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:16.322318 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:16.322607 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:16.322884 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:16.386275 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:16.387967 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:16.397591 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1483/2926] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:19.285799 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:19.306843 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187da11-c173-4ba0-8907-eaf2302ec341 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:19.319014 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:19.319801 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:19.320177 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:19.320519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:19.322754 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:19.347910 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:19.353718 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:19.370630 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1444/2927] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:22.619428 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:22.634800 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f72fc-c499-436e-9b82-923d2c6a0057 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:22.642017 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:22.642773 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:22.643028 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:22.643508 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:22.645754 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:22.663102 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:22.664965 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:22.686910 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1484/2928] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:22.689111 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:22.701560 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac781e-3a74-4431-b59a-1f64060878b4 service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:22.707419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:22.707419 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:22.709341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:22.709341 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] PATH_INFO: `/v3/users/9294e649dc51425ba978e70f4635ddb6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:22.711159 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9294e649dc51425ba978e70f4635ddb6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:22.712771 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:22.774033 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9294e649dc51425ba978e70f4635ddb6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:22.782921 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9294e649dc51425ba978e70f4635ddb6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:22.793598 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9294e649dc51425ba978e70f4635ddb6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:22.806767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9294e649dc51425ba978e70f4635ddb6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:22.807500 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9294e649dc51425ba978e70f4635ddb6'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:22.815542 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1445/2929] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:30:22 2022] DELETE /identity/v3/users/9294e649dc51425ba978e70f4635ddb6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:30:23.027293 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:23.045106 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b66b7-7c66-4d6b-b169-149c19bfddd6 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:23.126163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:23.127049 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:23.127331 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:23.127605 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] PATH_INFO: `/v3/projects/eb24e89507a54ec080cbb570f57ae7df` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:23.129968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb24e89507a54ec080cbb570f57ae7df)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:23.132944 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:23.195503 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb24e89507a54ec080cbb570f57ae7df', 'request_id': 'req-ffea72bd-e86b-43d8-afd7-7b306f79a277'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.204440 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb24e89507a54ec080cbb570f57ae7df', 'request_id': 'req-ffea72bd-e86b-43d8-afd7-7b306f79a277'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.214968 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb24e89507a54ec080cbb570f57ae7df', 'request_id': 'req-ffea72bd-e86b-43d8-afd7-7b306f79a277'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.223359 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:23.229430 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] The token cache is being invalidate because project eb24e89507a54ec080cbb570f57ae7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:30:23.229803 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.230768 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.232666 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1485/2930] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:30:23 2022] DELETE /identity/v3/projects/eb24e89507a54ec080cbb570f57ae7df => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:30:23.236790 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:23.238368 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:23.252919 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295077a-f52f-4b9e-9894-1e3a969d2f35 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:23.316394 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:23.317289 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:23.317569 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:23.317847 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] PATH_INFO: `/v3/users/3e9f42e02f7f40ea8ac850207cba47f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:23.319165 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9f42e02f7f40ea8ac850207cba47f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:23.321182 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:23.371583 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9f42e02f7f40ea8ac850207cba47f2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.373141 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:23.381353 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9f42e02f7f40ea8ac850207cba47f2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.393767 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9f42e02f7f40ea8ac850207cba47f2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.407102 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9f42e02f7f40ea8ac850207cba47f2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.407836 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9f42e02f7f40ea8ac850207cba47f2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.414255 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1446/2931] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Jun 3 13:30:23 2022] DELETE /identity/v3/users/3e9f42e02f7f40ea8ac850207cba47f2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:30:23.607348 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:23.608936 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:23.625055 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea72bd-e86b-43d8-afd7-7b306f79a277 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:23.687952 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0996f80baf904a69852b0b6c8fb6bc6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cee784ec8864757a1c8441df24c7f48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:23.688835 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:23.689120 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:23.689435 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] PATH_INFO: `/v3/projects/ee6a2fa636184e08a55bc498965d5382` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:23.690779 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6a2fa636184e08a55bc498965d5382)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:23.692747 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:23.742978 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6a2fa636184e08a55bc498965d5382', 'request_id': 'req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.750577 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6a2fa636184e08a55bc498965d5382', 'request_id': 'req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.760982 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6a2fa636184e08a55bc498965d5382', 'request_id': 'req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.772170 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] The token cache is being invalidate because project ee6a2fa636184e08a55bc498965d5382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:30:23.772460 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.773117 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd0d5a78-7435-4ad3-8039-a3dc34ab0536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:23.774740 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1486/2932] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Jun 3 13:30:23 2022] DELETE /identity/v3/projects/ee6a2fa636184e08a55bc498965d5382 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:30:33.410519 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=12,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:33.769163 dv-cinder-779540-3-iscsi devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:48.133018 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:48.135360 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:48.223866 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e36b5-2f3e-45ed-a700-6cd3cec2a64d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:48.290966 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b56e-0e80-4f34-9da3-b9c17d2ad354 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7694db301bef4371a85993f54ad55d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d17e6e9d84005b102db6b4db8e22d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:48.291627 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b56e-0e80-4f34-9da3-b9c17d2ad354 service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:48.291915 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b56e-0e80-4f34-9da3-b9c17d2ad354 service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:48.292191 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b56e-0e80-4f34-9da3-b9c17d2ad354 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:48.294668 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0d31b56e-0e80-4f34-9da3-b9c17d2ad354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:48.306565 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b56e-0e80-4f34-9da3-b9c17d2ad354 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:48.308174 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b56e-0e80-4f34-9da3-b9c17d2ad354 service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:48.318945 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1447/2933] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 3 13:31:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:31:58.314402 dv-cinder-779540-3-iscsi devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=58 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}